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(57) Abstract; Methods are disclosed for assessing the condition of a cartilage in a joint, paiticularly a human knee. I1ie methods 
include converting an image such as an MRI to a three dimensional map of the cartilage. The caitilage map can be correlated to a . 
movement pattern of the joint to assess the afTcct of movement on cartilage wear. Changes in the thickness of cartilage over time 
can be determined so that therapies can be provided. Information on thickness of cartilage and curvature of cartilage or subchondral 
bone can be used to plan therapy. Information on movement pattern can be used to plan therapy. 
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ASSESSmG THE CONDITION OF A JOINT AND 
DEVISING TREATMENT 

This invention was supported in part by a National Institute of Health Grant No. PAR-97- 
014, and the government may have rights in this invention. 

BACKGROUND OF THE INVENTION 
FIELD OF INVENTION 

This invention relates to assessing tiie condition of a joint and the use of the assessment in 
aiding in prevention of damage to the joint or treatment of diseased cartilage in the joint. 

BACKGROUND 

Osteoarthritis is the most common condition to affect human joints as well as a 
fiequent cause of locomotor pain and disability. More particularly, osteoartiiritis (OA) of 
the knee occurs in a substantial portion of the population over the age of fifty. 

In spite of its societal impact and prevalence, however, there is a paucity of 
information on the factors that cause osteoarthritis to progress more rapidly in some 
individuals and not in others. Previously considered a ^Vear and teaf ' degenerative disease 
with littie opportunity for therapeutic intervention, osteoarthritis is now increasingly viewed 
as a dynamic process witii potential for new pharmacologic and surgical treatment 
modalites such as cartilage transplantation, osteochondral alio- or autografting, osteotomies 
and tibial corticotomies with angular distraction. 

However, tiie appropriate deployment and selection of treatment interventions for 
OA is depmdent on tiie development of better mefliods for tiie assessment of tiie condition 
of a patient's joint and the degeneration process. 

There is, therefore, a need for improved methods for examining the factors that 
influence as well as quantification of the progression of the disease. 

Magnetic resonance imaging (MRI) is an accurate non-invasive imaging technique 
for visualization of articular cartilage in osteoarthritis, particularly m knees. However. 
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• V current MRI techniques cannot provide information on the relationship between the location 

of the cartilage loss and variations in the load bearing areas during the walking cycle. This 
information is important since it has bem shown that dynamic loads during walking are 
related to the progression of knee OA. Thus, tibe ability to locate cartilage defects or areas of 
S cartilage thimiiTig relative to the load bearing areas of the knee could be vahiable in 
evaluating &ctors influencing the progression of osteoarthritis. 
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SUMMARY OF THE DIVENTION 



This invention relates to assessing the condition of a joint of a mammal, particularly 
a human subject, using the assessment to treat and monitor the subject as needed for 
cartilage degeneration problems. While the numerous aspects of the invention are useful for 
joints generally, they are particularly suited for dealing with the human knee. Some aspects 
25 related the static images and degeneration patterns of a cartilage, while others relate to the 
int^action of such images and patterns to provide a better means of assessing the condition 
of a cartilage. 

One aspect of this invention is a method for assessing the condition of a cartilage. 
The method conq>rises obtaining an image of a cartilage, Qjreferably a magnetic resonance 
30 image), converting the image to a three-dimensional degeneration pattern, and evaluating 
the degree of degeneration in a volume of interest of &e cartilage. By performing fliis 
method at an initial time T, and a later time Ti, one can determine the change in ttie volume 
of interest and evaluate what steps to take for treatment 
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Another aspect of this inventioii is a method of estimatuig the loss of cartilage in a 
joint The method comprises obtaining a fliree-dimensional map of the cartilage at an initial 
time and calculating the thickness or regional volmne of a region thought to contain 
degenerated cartilage so mapped at the initial time, obtaining a three-dimensional map of 
5 the cartilage at a later time, and calculating the thickness or regional volume of the region 
fliought to contain degenerated cartilage so mappGd at the later time, and detenniiiing the 
loss in thickness or regional volume of the cartila^ between die later and initial times. The 
3D m^ may be a thickness map, a biochemical map or a combination. 

Another aspect of the invention is a method for assessing the condition of cartilage 

10 in a joint of a human, which mettiod comprises electronically transferring an electronically- 
generated image of a cartilage of the joint ftom a transferring device to a receiving device 
located distant fiom the transferring device; receiving the transferred image at the distant 
location; converting the transferred image to a degeneration pattern of the cartilage; and 
transmitting the degeneration pattern to a site for analysis. 

15 Another aspect of tiie invention is a method for determining the volume of cartilage 

loss in a region of a cartilage defect of a cartilage in joint of a mammal. The method 
comprises (a) determining the thickness, Dn, of the normal cartilage near the cartilage 
defect; (b) obtaining the thickness of the cartila^ defect, Dd, of the region; (c) subtracting 
Dd fiom Dn to give the thickness of die cartilage loss, Dl; and (d) multiplying the Dl value 

20 times the area of the cartilage defect. Ad, to give the volume of cartilage loss. 

Still another aspect of the invention is a method of estimating the change of a region 
of cartilage in a joint of a mammal over time. The method coiiq)rises (a) estimating the 
width or area or volume of a region of cartilage at an initial time Ti, (b) estimating the 
width or area or volume of the region of cartilage at a later time T2, and (c) determining the 

25 change in the width or area or volume of the region of cartilage between the initial and the 
later times. 

Still another aspect of the invention is a method of estimating the loss of cartilage in 
a joint The method conoprises (a) defining a 3D object coordinate system of the joint at an 
initial time, Ti; (b) identiiying a region of a cartilage defect within the 3D object coosrdinate 
30 system; (c) defining a volume of interest around the region of the cartilage defect whereby 
the volume of interest is larger than the region of cartilage defect, but does not encompass 
the entire articular cartilage; (d) defining the 3D object coordinate system of the joint at a 
second timepoint, T2; (e) placing the identically-sized volume of interest mto flie 3D object 
coordinate syston at timepoint T2 using the object coordinates of the volume of interest at 
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timepoint Ti; (£) and measuring aay differences in cartilage volume within the volume of 
interest between timepoints Ti and T2. 

Another aspect of this invention is a method for providing a biochemically-based 
map of joint cartilage. The method comprises measuring a detectable biochemical 
5 component throughout the cartilage, dctemiining the relative amounts of the biochemical 
component throughout the cartilage; mapping the amounts of the biochemical component 
through the cartilage; and deteraiining the areas of cartilage deficit by identifying the areas 
having an altered amount of the biochemical component present 

Once a map is obtained, it can be used in assessing the condition of a cartilage at an 
10 initial time and over a time period. Thus, the biochemical m^ may be used in the method 
aspects of the invention in a manner similar to the cartilage thickness m^. 

Another aspect of this invention is a method for assessing the condition of cartilage 
in a joint from a distant location. The method comprises electronicaUy transfemng an 
electronically-generated image of a cartilage of the joint from a transferring device to a 
15 receiving device located distant from the transferring device; receiving flie transferred 
image at the distant location; converting the transferred image to a degeneration pattern of 
the cartilage; and transmitting the degeneration pattern to a site for analysis. 

Another aspect of the invention is a kit for aiding in assessing the condition of 
cartilage in a joint of a mammal, which kit comprises a software program, which when 
20 installed and executed on a computer reads a cartilage degeneration pattern presented in a 
standard graphics format and produces a computer readout showing a cartilage thickness 
map of the degenerated cartilage. 

Another aspect of this invention is a method for assessing the condition of a 
subject*s cartilage in a joint, the method comprises obtaining a three dimensional 
25 biochemical representation of the cartilage, obtaining a morphuiogicai representation of the 
cartilage, and merging the two representations, and simultaneously displaying the merged 
representations on a medium. The merged representations are then used to assess the 
condition of a cartilage, estimate the loss of cartilage in a joint, determining the volume of 
cartilage loss in a region of cartilage defect, or estimating the change of a region of cartilage 
30 at a particular point in time or over a period of time. 

A method for correlating cartilage image data, bone image data, and opto-electrical 
image data for the assessment of tiie condition of a joint, which method comprises (a) 
obtaining the bone image data of the joint with a set of skin reference markers positioned in 
extanally near the joint, (b) obtaining the opto-electrical image data of the joint with a set 
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of skin reference markos positioned in the same manner as (a), and (c) using the skin 
reference maxkers to correlate the images obtained in (a) and (b) with each other, herein 
each skin reference marker is detectable in the bone data and the opto-electrical data. The 
method also can be used to fur&er evaluate cartilage image data that is obtained using a 
5 similariy positioned set of skin refoence markers. 

Another aspect of the invention is a skin reference maiker &at cQnq>rises (a) a 
mataial detectable by an imaging technique; (b) a container for holding the inatftrial, (c) a 
material that causes the container to adhere to the skin of a human, and (d) a reflective 
material placed on the surface of the container. 

10 Ano^cT aspect of the invention is a biochemical map of a cartilage fliat conxpiises a 

floee-dim^ional r^resentation of the distribution of the amount of the biochemical 
coxoponent throughout the cartUage. 

Another aspect of the invention is a method for providing a biocheoiically-based 
map of joint cartilage of a mammal, wherein the joint comprises cartilage and associated 

IS bones on either side of the joint, which method comprises (a) measuring a detectable 
biochemical component throughout the cartilage; (b) determining the relative amounts of 
die biodbemical component throughout the cartilage; (c), mapping the amotmts of the 
biochemical componmt in three dimensions through the cartilage; and (d) determining the 
areas of abnorcoal joint cartilage by identifying fhc areas having altered amounts of the 

20 biochemical component present 

Another aspect of tiie invention is a method for deriving the motion of bones about a 
joint fix>m markers placed on the skin, which method comprises (a) placing at least three 
external markers on the patient's limb segments surrounding the joint, (b) registering the 
location of each marker on the patient's limb while the patient is standing completely still 

2:> and while moving tue liniu, (c) calculating the principal axis, principal moments and 
deformation of rigidity of the cluster of markers, and (d) calculating a correction to the 
artifact induced by the motion of the skin markers relative to the underlying bone. 

Another aspect of the invention is a system for assessing the condition of cartilage in 
a joint of a human, which system comprises (a) a device for electronicaUy transferring a 

30 cartilage degeneration pattern for the joint to a receiving device located distant finom the 
transforing device; (b) a device for receiving the cartilage degeneration pattern at the 
remote location; (c) a database accessible at the remote location for generating a movement 
pattern for die joint of the human wherein die database includes a collection of movement 
patterns of human joints, which patterns are organized and can be accessed by reference to 
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characteristics such as type of joint, gender, age, height, weight, bone size, type of 
movement, and distance of movement; (d) a device for generating a movement pattern that 
most closely approximates a movement pattern for the human patient based on the 
characteristics of flie human patient; (e) a device for correlating the movement pattern with 
5 the cartilage degeneration pattern; and (f) a device for transmitting the correlated movement 
pattern with the cartilage degeneration pattern back to the source of the cartilage 
degeneration pattern. 

A method for assessing ttie condition of the knee joint of a human patient, wherein 
the knee joint comprises cartilage and associated bones on either side of the joint, which 

10 method comprises (a) obtaining ttie patient's magnetic resonance imaging (MRT) data of the 
knee showing at least the bones on either side of the joint, (b) segmenting the MRI data 
fiom step (a), (c) generating a geometrical representation of the bone of the joint fiom the 
segmented MRI data, (d) assessing the patient's gait to determine the load pattern or the 
cartilage contact pattern of the articular cartilage in the joint during the gait assessment, and 

15 (e) correlating the load pattern or cartilage contact pattern obtained in stq) (d) with the 
geometrical representation obtained in step (c). 

Another aspect of the invention is a method of assessing the rate of degeneration of 
. cartilage in the joint of a tnimnnal^ wherein the joint comprises cartilage and the bones on 
dttier side of the cartilage, which method comprises (a) obtaining a cartilage degeneration 

20 pattern of the joint that shows an area of greater than nonnal degeneration, (b) obtaining a 
movement pattern of the joint that shows where the opposing cartilage surfiices contact, (c) 
comparing the cartilage degeneration pattern with the movement pattern of the joint, and (d) 
determining if the movement pattern shows contact of one cartilage surface with a portion 
of the opposing cartilage surface showing greater than normal degeneration in the cartilage 

25 degeneration pattern. 

Another aspect of the invention is a method for monitoring the treatment of a 
degenerative joint condition in a mammal, wherein the joint comprises cartilage and 
acconqpanying bones on either side of the joint, which method comprises (a) comparing the 
movement pattern of the joint with the cartilage degeneration pattern of the joint; (b) 

30 determining the relationship between the movement pattern and the cartilage degeneration 
pattern; (c) treating the mammal to minimize further degeneration of the joint condition; and 
(d) monitoring the treatment to the mammal. 

Still another aspect of the invention is a method of assessing the condition of a joint 
in a mammal, wherein the joint comprises cartils^ and accompaoiying bones on either side 
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of the joint, which m^od comprises (a) conipariiig the movement pattern of the joint with 
the cartilage degeneration pattern of the join^ and (b) determining the relationship between 
the movement pattern and the cartilage degeneration pattern. 

Other aspects of the invention may be parent iq>on fiirtiier reading the 
5 specification and claims of the patent application. 

BRIEF DESCRIPTION OF THE DRAWINGS 

In the accompanying drawings: 

10 

Figure 1 shows an overview schematic representation of some aq>ects of the invention of 
this apphcation. 

Figure 2 shows a DEFT pulse sequence. 

15 

Figure 3 shows flie signal levels for cartilage and synovial fluid with RARE and DEFT 
pulse sequences, both TE = 14 miliseconds. 

Figure 4 shows the mean contrast to noise ratio (CNR) of cartilage to joiot fluid for various 
20 MRI pulse sequences. 

Figure 5 shows the mean contrast for cartilage and joint fluid for various MRI pulse 
sequences. 

25 Figure 6 shows a DEFT acquisition u^mg non-selective refocusing pulses to maximize the 
SNR ef&ciency and a partial Echo-Plainer acquisition gradients in order to minimize the 
required scan time for 3D volume. 

Figure 7 shows four sample images acquired with a DEFT pulse sequmce combined with a 
30 partial K- Echo-Plainer acquisition in order to provide efBcient 3D coverage. 

Figures 8A and 8B show a 3-point Dixon GKB image of the articular cartilage of medial 
fennorotibial compartment in a nonnal 35-year old volunteer. Figure 13A has the subject in 
supine position and Figure 1 3B has flie subject in an upri^t position. 
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Figures 9A -9C show patieiit position and application of imaging coil and tracker coil for 
kinetic MR imaging of the knee. Patient is in upright weight-bearing position for active 
flexion and esctension study of the knee. 

5 

Figure 9B is a 2D cartilage thickness m^ demonstrating abrupt decrease in cartilage 
thickness in flie area of the defect (arrows). The A thickness between flie neighboring pixels 
can be use to define the borders of tiie cartilage defect. Note defused cartilage thinning in 
the area enclosed by the asterisks 

10 

Figures lOA-lOC show a 3D surface registration of femoral condyles based on Tl - 
weighted qjin-echo MR images. Figure 6A is a baseline with a knee and neutral position. 
6B is a follow-up with knee and external rotation with a 3D view that is the identical to the 
one used in 6A but the difference in knee rotation is apparent In Figure 6C, transformation 
15 and re-registration of Scan B into the object coordinate system of Scan A shows the 
anatomic match to A can be excellent 

Figure 11 A shows a 2D cartilage thickness map where a proton density fast ^in-echo MR 
image demonstrates a focal cartilage defect in the posterior lateral fermoral condyle (black 
20 arrows). White arrows indicate enc^ints of the thickness map. 

Figure 12 shows the anatomic coordinate system in the femur and in the tibia. 

Figure 13 shows calculation of the anatomic coordinate system from palpable bony 
25 landmarks. 

Figure 14 shows additional marker names and locations for MR to optical cross registration. 

Figure IS shows the marker names and locations for the standard point-cluster technique 
30 protocol. 

Figure 16 shows the error in the tibial location estimate for the rigid body model and the 
intrical deformation correction technique. 
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Figure 17 shows the error in tibial orientatioB estimate for the rigid body model and the 
interval deformation correction technique. 



Figure ISA - 181 show functional joint imaging. 

5 

Figure 19 shows the superinq>osition of the tibiofemoral contact line onto the 3D cartilage 
thickness map. 

Figure 20 shows the determination of the natural line of curvature as the cutting plain is 
10 rotated about the transepicondyear reference, flie cartilage-plain intersection results in a 
cxuve. 

Figure 21 shows the detemMnation of the tibiofemoral contact line through the proximity 
detection and £q>proach algorithm. 

15 

Figures 22A and 22B show a 2D MRI (3D SPGR) and 3D cartilage thickness map. 

Figures 23A- E show the matching of 3D thickness m^s generated fiom MR images 
obtained with a knee neutral position and external rotation. 

20 

SPECIFIC DESCRBPnON 
Overview 

25 Figure 1 is a schematic overview of some of the various aspects of the invention. 

While a conqplete description of ttie many aspects of the invention is found in the 
specification and claims^ the schematic overview gives some of the broad aspects of the 
invention. 

This invention relates to assessing the condition of a joint in a mammal. One aspect 
30 is a method for such an assessment The assessment can be done using internal images, or 
m^s, of the cartilage alone or in combination with a movement pattern of the joint If used 
alone, a m^ obtained at an initial time is compared with a map obtained at a later time to 
provide a view of the change in cartilage over time. Another aspect is a method is 
comparing the movement pattem for a joint of a subject being studied with the cartilage 
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degeneration pattern of the subject, then determining the relationship between the 
movement pattern and the degeneration pattern. If, in determining the relationship between 
the two patterns, one finds that the movemrat pattern has caused the degeneration pattern or 
will continue to adversely affect the degeneration pattern, therq^y can be prescribed to 
5 minimize the adverse effects, such as further degeneration or inflammati on. 

In overview, some of the systems and methods of this invention are illustrated by the 
flow chart in the attached Figure 1. Figure 1 is based on the full range of processes, 
preferably ^lied to a knee and surrounding cartilage. 

In Figure 1, the first step 10 represents obtaining an image of the cartilage itself 
10 This is typically achieved using MRI techniques to take an image of the entire knee and 
tiien, optionally, manipulating (eg., "subtracting our or "extracting") the non-cartilage 
images as shown in step 12. Non-cartilage images typically come firom bone and fluid. 
Preferably, the MRI is taken using external markers to provide reference points to the MRI 
image (step 11). 

15 If the cartilage is imaged with a 2D MRI acquisition technique, the resulting stack of 

2D images so obtained can be combined into a 3D image, as indicated in step 14. A 
preferred alternative is to use 3D MRI acquisition techniques to acquire a 3D image 
directly, hi either case, the same **non-cartilage image extraction techniques referred to in 
step 12 can be used. 

20 With a fiill 3D image cq)tured, various **maps" or displays of the cartilage can be 

constructed to give a cartilage degeneration pattern. This is represented by step 16. One 
such display can, for example, be a color-coding of a displayed image to reflect the 
thickness for the cartilage. This will allow easy visual identification of actual or potential 
defects in the cartilage. 

25 Together with or independmtiy of the cartilage imaging, and as represented by 

parallel step 20, a 3D image of the knee joint is takm, again preferably using MRL Many of 
the same techniques as appUed in steps 10 to 14 are used to do this. However, as illustrated 
by sub*step 22, it is useful to define and register a skin-external fiame of reference around 
the joint This is achieved by placing fiduciary markers on the skin around the outside of 

30 tiie knee (step 22) prior to taking the image. 

In addition to an image extraction technique (as described above in step 12), an 
image is manipulated to enhance the image of the position of the markers (stq> 24). The 
resulting manipulated image is used to give a 3D image of the joint and associated bones 
(step 26). 
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With the maikers in place, and as shown by step 30, an additional set of mariners is 
placed on the skin along the outside of the leg, and an external image of the limb is 
obtained. Using at least two cameras, images are then taken of the subject in a static state. 
In addition, images are also taken of the subject while moving. This is shown collectively 
5 by step 32. The images obtained are tfam processed to relate die movement of the skin 
relative to the bone. In addition, certain calculations are performed, for exanq)le, the center 
of mass is calculated. These manipulatioiis are shown in Stq> 34. Further, as the fiduciary 
markers are still in place during the video image cq[>ture, a correlation between the fiduciary 
and the additional set of maikers can be made. This is shown in step 36. 

10 Once this maiker-to-maiker correlation is made, the static 3D image of the joint 

(with associated fidudary maikers) and the movem^t images of the leg bones (also with 
fiduciary markers in place) can be combined. The fiduciary markers, therefore, serve as 
baseline references. Hie combination (stq> 40) of 3D cartilage image (fiom step 14), 3D 
knee joint image (step 26), and the moving leg co-ordinates (step 34) will, after ^lopriate 

15 corrections, result in a displayable, 3D motion image of the joint moving as per step 46. 

The moving images, showing the contact areas of the knee joint can be used in conjunction 
with the various **maps" or displays generated at step 16 to provide a visual indication of 
potential or actual cartilage defects and help in determining their relation between 
movement and degeno^on patterns. This is shown in step 48. 

20 Furthermore, as the various images are siq>ported by actual mathematical 

quantification, real measurements (such as cartilage thickness) can be taken and compared 
with later or earlier measurements and/or imaging. This allows the tracking of the 
progression of a defect, or conversely, continued tracking of healthy cartilage. This aids a 
health worker in providing therapy for the patients. The method allows monitoring and 

25 evaluation of remedial actions as well as possible treatment prescriptions. 

Thus, this invention discloses, for example, a method to examine the relationship 
between articular cartilage morphology and the functional load bearing areas of a knee joint . 
measured during movement The method includes enhanced imaging techniques to 
reconstruct the vohnnetric and biochemical parameters of the articular cartilage in three 

30 dimensions; and a method for in vivo kinematic measurements of the knee. The kinematic 
measurement pennits direct in vivo measurements of complete six-degrees of fi:eedom 
motion of the femur or the tibia or associated bones during normal activities. This permits 
die study of load bearing of articular cartilage during movement In particular, this method 
can aid in locating cartilage defects relative to the changing load bearing areas of the knee 
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joint during daily activities. WhUe the various aspects of the inveation are useful in 
mammals generally, fliey are particularly useful for human patients. 



Obtaining the Cartilage Degeneration Pattern 
5 Imaging Articular Cartilage 

Jn general, the joint of a patient is that place of union, more or less movable, 
between two or more bones. A joint comprises cartUage and other elements such as the 
accompanying bones on either side of the joint, fluid, and other anatomical elements. Joints 
are classified into three general morphological types: fibrous, cartilaginous, and synovial. 

10 This invention is particularly useful for assessing synovial joints, particularly flie knee. 

In obtaining an image of the cartilage of a joint in a mammal, a number of internal 
imaging techniques known in the art are useful for electronically generating a cartilage 
image. These include magnetic resonance imaging (MRI), computed tomography scanning 
(CT, also known as computerized axial tomography or CAT), and ultrasound imaging 

15 techniques. Others may be parent to one of skill m the art MRI techniques are preferred. 

MRI, with its superior soft tissue contrast, is the best technique available for 
assessing tissue and its defects, for exanq)le articular cartilage and cartilage lesions, to 
obtain a cartilage degeneration can provide morphologic information about the area of 
damage. Specifically, changes such as fissuring, partial or fiill thickness cartilage loss, and 

20 signal changes within residual cartilage can be detected 

The reason MR imagmg techniques are particularly suitable for cartilage is because 
they can provide accurate assessment of cartilage thickness, demonstrate internal cartilage 
signal changes, evaluate the subchondral bone for signal abnormalities, and demonstrate 
morphologic changes of the cartilage surface. 

25 MRI provides several toqportant advantages over other techniques in this inventioa 

One advantage is good contrast between cartilage, bone, jomt fluid, Ugaments, and muscle 
in order to facilitate the delineation and segmentation of the data sets. Another is the 
coverage of tiie entire region of interest in a single scan within acceptable acquisition times. 
For a brief discussion of the basic MRI principles and techniques, see MRI Basic Principles 

30 and Applications, Second Edition, Mark A. Brown and Richard C. Semelka, Wiley-Liss, 
Inc. (1999). 

MRI employs pulse sequences that allow for better contrast of different parts of tiiie 
area being imaged. Different pulse sequences are better fitted for visualization of different 
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anatomic areas, for exanple^ iiyaiine cartilage or joint fluid. More than one pulse sequence 
can be employed at the same time. A brief discussion of dififerent types of pulse sequences 
is provided below. 

High Resolution 3D MRI Pulse Sequences 

Routine MRI pulse sequences available for imaging tissue, such as cartilage, include 
conventional Tl and T2-wei£^ted spin-echo imaging; gradient recalled echo (GRE) 
imaging , magnetization transfer contrast (MTC) imaging, &st spin-echo (FSE) imaging, 
contrast enhanced imaging, nq>id acquisition relaxation enhancemrat, (RARE) imaging, 
gradient echo acquisition in the steady state, (GRASS), and driven equilibrium Fourier 
transform (DEFT) imaging. As these imaging techniques are well known to one of skill in 
the art, e.g, someone having an advanced degree in imaging technology, each is discussed 
only generally hereinafter. While each technique is useful for obtaining a cartilage 
degeneration pattmi, some are better than others. 

Conventional Tl and Tl-Weighied Spin-Echo Imaging 

Conventional Tl and T2-weighted MRI depicts articular cartilage, and can 
dononstrate defects and gross morphologic changes. Tl-weighted images show excellent 
intra-substance anatomic detail of hyaline cartilage. However, Tl -weighted imaging does 
not show significant contrast between joint effusions and the cartilage surfece, making 
surfece irregularities difficult to detect T2-wei^ted imaging demonstrates joint effiisions 
and thus surface cartilage abnormalities, but since some components of cartilage have 
xeiatively short T2 .wiaxatiou times, these are not as well depicted as other preferred 
imaging. 

Gradient-Recalled Echo Imaging 

Gradient-recalled echo imaging has 3D equability and ability to provide hi^ 
resolution images widi relatively short scan times. Fat suppressed 3D spoiled gradient echo 
(FS-3D-SPGR) imaging has been shown to be more sensitive than standard MR imaging for 
the detection of hyaline cartilage defects in the knee. 
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Magnetization Transfer Contrast Imaging 

CartUage, as well as other ordered tissues, demonstrate the effects of magnetization 
transfer. Magnetization transfer unaging can be used to separate articular cartilage from 
S adjacent joint fluid and inflamed synovium. 

Fast Spin-Echo Intaging 

Fast spin-echo imaging is ano&er useful pulse sequence to evaluate articular 
10 cartilage. Incidental magnetization transfer contrast contributes to the signal characteristics 
of articular cartilage on fest spin-echo images and can enhance the contrast between 
cartilage and joint fluid Sensitivity and specificity of fast spin-echo imaging have been 
reported to be 87% and 94% in a study with arthroscopic correlation. 

15 Contrast Enhanced Imaging 

The use of gadolinium for imaging of articular cartilage has been jq>plied in several 
different fonns. Direct magnetic resonance (MR) arthrogr^hy, wherein a dilute solution 
containing gadolinium is injected directly into flie joint, improves contrast between cartilage 
20 and the arthrogr^hic fluid. Indirect MR arthrography, with a less invasive intravenous 
injection, can also been i^lied. Gadolinium enhanced imaging has the potential to monitor 
glycosaminoglycan content within the cartilage, which may have impUcations for 
longitudinal evaluations of injured cartilage. 

25 Driven Equilibrium Fourier Transform 

Another 3D imaging method that has been developed is based on the driven 
equilibrium fourier transform (DEFT) pulse sequence (U.S. Patent No. 5,671,741), and is 
specifically designed for cartilage imaging. DEFT provides an effective tradeoff between 
30 T2/T1 weighting and spin density contrast that delineates the structures of interest in the 
knee. Contrast-to-noise ratio between cartilage and joint fluid is greater with DEFT than 
with spoiled gradient echo (SPGR). DEFT is an alternative approach to SPGR. DEFT 
contrast is very well suited to imaging articular cartilage. Synovial fluid is high in signal 
' intensity, and articular cartilage intennediate in signal intensity. Bone is dark, and lipids are 

23 



wo 02/22014 



PCTA]S0iy28680 



suppressed using a M saturation pulse. Hence, cartilage is easily distinguished fiom all of 
the adjacent tissues based on signal intensity alone, which will greatly aid segmentation and 



The basic DEFT pulse sequence is shown in Fig. 2. A conventional spin echo pulse 
sequence was followed by an additional refocusing pulse to form another echo, and ttien a 
reversed, negated, ^citation pulse to retum any residual magn^ization to the +z axis. This 
preserved the magnetization of longer T2 species, such as synovial fluid. Typical MRI 
paiamet^ for cartilage are a Tl-relaxation time of 900 Milliseconds (ms) and a T2- 
relaxation time of 40 ms, while synovial fluid has a Tl-relaxation time of 3000 ms and a 
T2-relaxation time of 200 ms. hi addition, synovial fluid has a 30% greater proton density 
than cartilage. The signal levels of cartilage and synovial fluid were plotted in Fig. 3 for a 
RARE pulse sequence and for DEFT, and show that DEFT mainteins excellent contrast for 
any relaxation time (TR). It achieves this contrast while maintaining a signal-to-noise ratio 
(SNR) eflBdency (SNR/(Tacquisitioo)) that is equal to or better than other meflKxls with much 
lower contrast, such as Tl -weighted GRASS. 

DEFT was compared with a fast spin-echo (FSE), a gradient-echo (GRE), and a 
^iled gradient-echo (SPGR) sequence with parameters similar to the ones pubUshed by 
Disler et al. Tlie patella was scanned in 10 nonnal volunteer knees using a L5T whole-body 
system (GE Signa) with a 3 indi sur&ce coiL All images were acquired with field of view 
(FOV) 10x10 cm, matiix 256x256 elements, slice thickness 4 mm lining fat-saturation. 
DEFT (400/15 [TR/TE in msec], 2 NEX (number of excitations), FSE (3500/15, echo train 
length [ETL] 8, 2 NEX (number of excitations), FSE (3500/15, ETL 4, 2 NEX), GRE 
(400/20, 30', 2 NEX), and SPGR (50/15, 30" [flip angle], 2 NEX) images were obtained. 
Contrast-to-noise ratios (CNR) between cartilage and joint fluid were calculated as: 



hi the equations SI is signal intensity. DEFT demonstrated greater contrast-to-noise 
ratio and contrast between cartilage and joint fluid than SPGR, GRE, and FSE sequences 
(Figs. 4 & 5). Cartilage had intemediate signal mtensity with DEFT, while joint fluid was 
hig^ m signal mtensity. The difference m CNR between DEFT and SPGR was statistically 
significant QxO.OOl). Cartilage moiphology, i.e. cartilage layere, were consistently best 



subsequent volume calculations. 




[Eq.2] 



[Eq.l] 
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delineated with the DEFT sequence. At the resolution used in this study, FSE sequences 
suffered fiom image bhnring. Blurring was improved with ETL 4 when compared to ETL8; 
nonetheless, even with ETL 4, cartilage morphology seen on FSE images was inferior to the 
DEFT sequence. In li^t of these results, DEFT imaging is a preferred MRI technique. 

5 . 

Another Application of DEFT 

DEFT was combined with a partial k-space echo-planar data acquisitiorL This pulse 
sequence is illustrated in Fig. 6 above. A slab selective pulse in z defines the imaging 

10 volume, which is then resolved with phase-encoding gradients in the y and z axes, and an 
oscillating EPI gradient in flie x axis. 

Example images acquired with this approach are shown in Fig. 7. This case was 
optimized for resolution, in order to image the patellar cartilage. The EPI readout acquired 5 
echoes for each DEFT sequence. Partial k-space acquisition collected only 60% of tiie data 

15 along the x-axis. Correction for the missing data was performed using a homodyne 
reconstruction. The image matrix was 192x192x32, with a resohition of 0.5x0.5x2.5 mm, 
resulting in a 1 Ox 1 0x8 cm FOV. The echo time TE was 22 ms, and the TR was 400 ms. Fat 
was siqipressed with a fat presaturation pulse. The total scan time for tiiis acquisition was 5 
minutes. 

20 Additional image studies that can be performed using this approach may require 

greater spatial coverage, but one can permit slightly less spatial resolution, and a longer 
scan time similar to the one used with the 3D SPGR {q)proach. If one relaxes the resolution 
to 0.75x0.75x1.5 mm, and doubles the z slab thickness and z phase encodes, the result will 
be a FOV of 15x15x16 cm, and a total scan time of ^proximately 15 minutes, which 

25 exacdy fits the desirea scan protocol. Similar lo the 3D SPGR acquisition, one can acquire a 
first 3D DEFT scan in the sagittal plane witii fit saturation. The 3D DEFT acquisition can 
then be repeated without &t saturation using the identical parameters and slice coordinates 
used during the previous acquisition with fet saturatioa The resultant non-fiit-saturated 3D 
DEFT images can be used for 3D rendering of ibs femoral and tibial bone contours. 

30 hi summary, Driven Equilibrium Fourier Transform is a pulse sequoice preferred 

for cartilage imaging that provides higher contrast-to-noise ratios and contrast between 
cartilage and joint fluid fbaa SPGR, GRE, and FSE sequences. Cartilage morphology is 
better delineated witii DEFT sequences than with SPGR, GRE, and FSE images. The 
. combination of high anatomic detail and hi^ cartilage-joint fluid CNR and contrast may 
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Trader this sequence particularly useful for longitudinal studies of cartilage in patients with 
osteoar^tis. 



A RqiTBseotative Example of MR Imaging is described below: 



A MR image can be performed using a whole body magnet operating at a field 
strength of 1.5 T (GE Signa , for exanq>le, equipped with the GE SR-120 high speed 
gradients [2.2 Gauss/cm in 184(isec risetimes]). Prior to MR imaging, external markers 
filled with Gd-DTPA (Magnevist®, Berlex Inc., Wayne, NJ.) doped water (Tl relaxation 
time approximately 1.0 sec) can be applied to the skin around the knee joint and optionally 
at die same positions used for gait analysis in a biomotion laboratory (discussed below). 
The external markers can be included in the field of view of all imaging studies. Patients 
can be placed in the scanner in supine position. After an axial scout sequence, coronal and 
sagittal Tl-wdghted images of the femur can be acquired using fee body coU (spin-echo, 
TR=500msec, TE=15msec, 1 excitation (NEX), matrix 256x128 elements, field of view 
(FOV) 48 cm. slice thickness 7 mm, intersUce spacing 1 mm). The scanner table can dien be 
moved to obtain ooronal and sagittal images of the knee joint and tibia using the same 
sequence parameters. These Tl-weighted scans can be employed to identify axes through 
the fomur and tibia which can be used later for defining the geometry of the knee joint The 
knee can then beplaced in the knee coil with the joint space located in the center of the coiL 
The knee can be secured in the coil with padding. Additionally, the foot and ankle region 
can be secured in neutral position to the scanner table using adhesive tape in order to 
minimize motion artifects. A rapid scout scan can be acquired in the axial plane using a 
gradient echo sequence (GRASS, 2D Fourier Transform (2DFT), TR=50msec 
TE=10msec flip angle 40», 1 excitation (NEX), matrix 256x128 elements, field of view 
(FOV) 24 cm, slice thickness 7 mm, interslice spacing 3 mm). This scout scan can be used 
to demonstrate the position of the knee joint space in the coil and to prescribe all subsequent 
high resolution imaging sequences centered over tiie joint space. AdditionaUy, using the 
graphic, image based sequence prescription mode provided with the scanner software, tiie 
scout scan can help to ensure that aU external markers around the knee joint are included in 
the field of view of die high resohition cartilage sensitive MR sequences. 

There are several issues to consider in obtaining a good image. One issue is good 
contiast between cartilage, bone, joint fluid, ligaments, and muscle in oider to facilitate the 
delineation and segmentation of the data sets. Another is the coverage of bofli condyles of 
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the knee in a single scan within acceptable acquisition times. In addition, if there are 
external markers, these must be visualized. One way to address these issues is to use a 
three-dimensional spoUed gradient-echo sequence in the sagittal plane with the following 
parameters (SPGR, 3DFT, fiit-saturated, TR=60msec •IE=5msec, flip angle 40°, 1 

5 excitation (NBX), matrix 256xi60 elements, rectangular FOV 16x12 cm. sHce thickness 1.3 
mm, 128 slices, acquisition time approximately 15 min). Using these parameters, one can 
obtain complete coverage across the knee jomt and the external markers both in 
mediolaleral and anteroposterior direction while achieving good spatial resolution and 
contrast-to-noise ratios between cartilage, bone and joint fluid (Figs. 8 and 9). The fet- 

10 saturated 3D SPGR sequences can be used for rendering the cartilage in three dimensions 
(see description below). The 3D SPGR sequence can then be repeated in the sagittal plane 
without fat saturation using the identical parameters and slice coordinates used during the 
previous acquisition with fat saturation. The resultant non-fet-satarated 3D SPGR images 
demonstrate good contrast between low signal intensity cortical bone and higji signal 

15 intensity bone manow thereby facilitating 3D rendering of the femoral and tibial bone 
contours. It is to be understood that this ^roach is rq)resentative only and should not be 
viewed as limiting in any way. 



20 



Volumes of Interest (VOJ) 



The invention allows a health practitioner to determine cartilage loss in a 
iq}roducible fashion and thus foUow the progression of a cartilage defect over time. 

In one embodiment of the invention, one can use a 2D or a 3D surface detection 
technique to extract the surfece of the joint, e.g. the femoral condyles, on both baseline and 

25 foUow-up scans. For exanq^le, a Tl-weighted spin-echo sequence can be used for surf5u;es 
extraction of tfie femoral condyles. The Tl-weighted spin-echo sequence provides high 
contrast b^een low signal intensity cortical bone and higji signal intensity fatty marrow. 
For detection of the surfiu^ of flie femoral condyles, a stq>-by-step problem solving 
procedure, Le., an algorithm, can convolve a data set with a 3D kernel to locate the 

30 maximum gradient location. The maximum gradient location corresponds to the zero 
crossing of a spatial location. When the kernel is designed properly, then tiiere will be only 
one zero oossing in the mask. Thus, that zero crossing is the sur&ce. This operation is 
preferably three-dimensional rather than two-dimensional. The sur&ce of tiie joint, e.g. tiie 
femoral cond^es, on the baseline scan can be registered in an object coordinate system A. 
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The sur&ce of the joint, e.g. fhe femoral condyles, on the foIlow-iq> scan can be registered 
in an object coordinate system B. Once these surfaces have been defined, a transfomiation 
B to B' can be performed that best matches B' with A. Such transfonnations can, for 
exanq)le» be performed using a Levenberg Marquardt technique. Alternatively, the 
5 tramformations and matching can be applied to the cartilage only. The same transformation 
can be qiplied to the cartilage sensitive images on the follow-iq> scan in order to match the 
cartilage surfices. 

Using file 3D sur&ce registration of the joint on &e baseline scan artd resultant 
object coordinate system A, one can place volumes of interest over the area of a cartilage 

10 defect seen on the cartilage sensitive images. For exanq>le, in the knee joint, fhe size of the 
targeted volumes of interest can be selected to exceed that of tfie cartilage defect in 
anteroposterior and mediolateral direction, e.g. by 0.5 to 1 cm. If the defect is located high 
on the femoral condyle or in the trochlear region, the targeted VOI can be chosen so that its 
size exceeds ttiat of the cartilage defect in superoinferior and mediolateral direction. The 

15 third dimension of the targeted VOI (parallel to the surface normal of the cartilage) can be 
fixed, for example at 1 cm, VOI size and placanent can be manual or automatic on the 
baseline study. Once the targeted VOI has been placed on the image using visual or 
automated computer control, the 3D coordinates of the targeted VOI relative to the 3D 
contour of fiie joint and object coordinate system A can be registered and saved. On foUow- 

20 up studies, e.g, scans inadvertently obtained with slightly difTerent patient position, the 3D 
surface of the joint is registered to match the orientation of the baseline scan and the 
targeted VOI is then automatically placed on the joint using object coordinate system B* 
and the coordinates saved on the baseline study. Cartilage volume within the targeted VOI 
on baseline and follow-up studies can, for example, be determined using standard 

25 thresholding and seed growing techniques. 

Reference markers 

When obtaining fhe MR images for use in this invention, whether the MRI is of 
30 cartilage or of bone, external reference markers can be placed on the skin around the joint of 
fhe subject being imaged The external marker can be designed not only to show iq> in the 
MRI, but also to show iq) if an external image of the joint is obtained. The inqxwrtance and 
value of such unique reference markers will be discussed in more detail hereinafter. 
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Thus, one embodiment of Hit invention is a skin referaice maiksr that can be used 
in the assessment of the condition of a joint of a human. Multiple skin reference markers 
can be placed upon one or more limbs of a patient prior to internal imaging and external 
imaging. Each skin reference marker comprises a material detectable by an imaging 

5 technique, a container for the material in which flie container preferably has multiple 
surfaces, a means for affixing the container to the skin (e.g. an adhesive placed on at least 
one surface of the container in an amount sufficient to adhere the container to the drin of a 
human), and a reflective material (preferably retro-reflective) placed on another surface of 
the container located away from the adhesive. Several imaging techniques can be used that 

10 are able to detect the maricer. For example, magnetic resonance imaging is preferred, but, 
ultrasound, or X-ray are also useful. In the case of X-ray, furtiier manipulations. must be 
performed in which multiple X-ray images are assimilated by a computer into a 2 
dimensional cross-sectional image called a Computed Tomogr^hy (CT) Scan. The 
material detectable by an imaging can be eittier in a Uquid form or a solid form. The 

15 material can be any imaging contrast agent or solution, e.g. a paramagnetic material. The 
material can be a lanthanide, such as one belonging to the yttrium group of rare earth 
metals. More specifically, the material can be gadolinium. The shape of the container can 
be any shape allowing it to be placed on the skin of a human. For example, it can be 
cubical, spherical, elliptical, discoid or cylindricaL The size of the container can be any 

20 size, but optimally a size allowing it to be recorded by an imaging machine. The longest 
dimension of the container can be iq> to 5.0 cm, but preferably is about 0.25 to 2.0 cm. The 
reflective or retro-reflective material can be any material that is able to reflect light directly 
back to the source of the light so that the position of the reference maricer is captured by the 
opto-electrical recording means, e.g. a video camera. 3M Corporation makes several retro- 

25 reflective materials. 

Manipolating Images 

Once a magnetic resonance image is obtained, it can be manipulated to improve the 
30 image by reducing unwanted, non-cartilage images. 

Segmentation 
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To prqpare ttie data set for 3D lendering, the cartilage can be segmented image by 
image using a signal-intensity-based threshold combined with a seed growing tecbnique. 
The femoral, tibial, and patellar cartUage can be segmented separately based on the fat- 
saturated 3D SPGR or 3D DEFT sequoKe. Manual disarticulation can be performed by 
5 outlining the cartilage contour in areas ^ere &e signal intensity of fht articular cartilage is 
similar to that of adjacent structures. The contours of ttie femoral, tibial, and patellar bone 
can be segmented separately using the non-&t-saturated 3D SPGR or 3D DEFT sequence. 
Segmoitation software can allow for manual editing of cartilage thickness m^)s and 
cartilage defects detected using the above embodiments, hi this fashion, the operator can 

10 correct erroneous detection of cartilage defects in areas where the cartilage may be naturally 
tiunner. Such software includes seed-growing algorithms and active-contour algorithms 
that are run on standard PC's. A sharp interface is present between the high signal intensity 
bone marrow and the low signal intensity cortical bone thereby fiwahtating seed growing. 
Fat-saturated and non-fet-saturated 3D sequences can be acquired with the same field of 

15 view, slice thickness and sUce positions, thereby enabling siq)erini^x)sition and cross 
registration of any resultant 3D renderings of the femoral, tibial, and patellar cartilage and 
bone. External reference markers can aid in registering the 3D data in the same object 
coordinate system. 

3D m^ of cartilage thickness can be generated using several difiCTcnt techniques. 

20 One rq)resentative, but not limiting, ^proach uses a 3D surfece detection technique which 
is based on a 2D edge detector (Wang-Binford) that has been extended to 3D. This surface 
detection technique can generate surface points and their corresponding surface normal. To 
smooth the contour, the program samples 25 percent of the surface points and fits a cubic 
spline to the sample points. The program can compute the curvature along sample spline 

25 points and find two .-^ah^jIc points that have the maximiiTn curvature and are sq>arated by 
about half the number of voxels on the contour. These points partition the spline into two 
subcontours. For each subcontour, the program can conqiute the average distance between 
the points and the center of the mass. The program can designate the subcontour with the 
smaller average distance as the inner cartilage surface and the other subcontour as the outer 

30 cartilage surface (OCS). The intersect between the inner cartilage sur&ce (ICS) Oocated at 
the subchondral bone mter&ce) and the outer cartilage surface with the surface normal can 
be used to compute the 3D thickness of the articular cartilage on a pixel-by-pixel basis. 
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Three Dimensional Geometric Model Generation 

After the 3D image of cartUage and tiie 3D image of joint with bones (as discussed 
hereinafter), are obtained, for example, the set of segmented two dimensional MR images 

5 can be transformed to a voxel representation using a compute program developed in the 
AVS Express (Advanced Visual Systems, Inc., Waltham, MA). Every voxel has a value of 
2ero if it is not within an object of interest or a value ranging from one to 4095, depending 
on the signal intensity as recorded by the MRI machine. An isosur&ce can then be 
calculated that corresponds to the boxmdary elements of the volume of interest A 

10 tesselation of this isosurfece can be calculated, along with the outward pointing normal of 
each polygon of the tesselation. These polygons are written to a file in a standard graq)hics 
format (Virtual Reality Modeling Language Version 1 .0: VRML output language). 

Visualization Software 

15 One possible choice for the software program used to assess the cartilage 

degeneration pattern, the bones of the jomt, and the motion pattern of the patient is a user 
controllable 3D visual analysis tool. The program can read in a scene, which scene consists 
of the various 3D geometric rq>resentations or "actors" (for example, VRML files of the 
tibia, tibia cartilage, femur, femoral cartilage), the static relationship transformations 

20 between these actors, and, if available, sequence of transformations describing how these 
actors move with respect to each ottier as Oie patient performs some activity, such as 
walking, jogging, etc. 

The program can allow the user, through the use of the mouse and/or keyboard, the 
ability to observe the scene fiom arbitrary angles; to start and stop the ammation derived 

25 fiom tiie motion profiles and to observe the contact line and any cartilage lesions while the 
animation is running. Additionally, the user can derive quantitative information on the 
scene through selecting points with the mouse. 

The software progi am can be written in the CTT computer language and can be 
compiled to run on both Silicon Graphics Woricstations and Windows/Intel personal 

30 computers. 

Cartilage thickness maps 
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Cartilage fludaiess can be detenxuned by several meOiods. One exanqile is 
detecting the locations of flie bone - cartilage and the cartilage - joint fluid inter&ce along 
the sur&ce nonnal using flie same edge detector described below, and subtracting them. 
This procedure can be r^eated for each pixel located along the bone- cartilage interfiice. 
The X, y, and z position of each pixel located along flie bone- cartilage inter&ce can be 
registered on a 3D tsvap or multiple 2D m^s and thickness values are translated into color 
values. In this £ishion, the anatomic location of each pixel at the bone cartilage inter&ce 
can be displayed simultaneously with the Ihickness of the cartilage in this location. 

The edge detector can produce accurate sur&ce points and their corresponding 
surface normal. The detector can be applied to the baseline and the £>llow-iq> data set For 
the baseline data set, both the sur&ce points and surface normals can be used to form locally 
siqjporting planes (for each voxel). These planes can form an approximated surface for the 
baseline skeletal site. As for the foUow-iq) data set, the sur&ce points can be matched in the 
registration procedure onto flie surface of the baseline data set One can use a newly 
developed 3D surface detection technique to extract the surface of the skeletal site on both 
the baseline scan and the follow-up scan. Once these surfaces are detected, one can use the 
Levenberg Marquardt procedure to find the transformation that best matches these two 
surfaces. 

A possible qjproach for calculating the cartilage thickness is based on a 3D 
Euclidian distance transformation (EDT). After thresholding, the voxels on the edge of the 
cartilage structure can be extracted using a slice by slice 8-neighbor search, resulting in a 
binary volume with the voxels on the cartilage surface having a value of 1 and all others 
being 0. To classify these surface points as part of the ICS or OCS, a semi-automatic 
approach, which requires the user to enter a point that lies outside the cartilage structure and 
faces the ICS, ^aa be useful From tLl„ jj>oint, rays are cast in all directions of the volume 
using a modified Bresenham's line drawing algorithm. If a ray hits a voxel with a value of 
1, this point is classified as part of the ICS. After a complete sweep of the volume, for. 
initiahzation of the EDT the ICS voxels are given a value of 0, whereas all other voxels are 
set to 1. 

For computation of the EDT, the following representative algorithm can be useful. 
It can decompose the calculation into a series of 3 one-dimensional transformations and can 
use flie square of the actual distances, which accelerates the process by avoiding the 
determination of square roots. 
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Fiist, for a bmary input picture F = {fsic} (1 ^ i ^L, 1 ^ j :SM, 1 ^k^N) anew 
picture G={giik} can be derived using equations (3-5) (a, P, and y denote the voxel 
dimensions). Here F is a set of all voxels initially and G is a set of all voxels at the later 
time. 

5 

g^=inin{{a(i-x))^/^=0;l<x^Z} lEq.3] 



TTius, each point can be assigned the square of the distance to the closest feature 
point in the same low in i-direction. Second, G can be converted into H={hyk} using 
10 equation (4). 



The algorithm can search each column in the j-direction. According to the 
15 Pythagorean theorem, the sum of the square distance between a point (ij Jc) and a point 
(i,yjk:) in the same column, (pQ - y))^, and the square distance between (UyX) and a 
particular feature point, equals the square distance between the point (ij Jc) and that 
feature point. Hie mmimiim of these sums is the square distance between (ijjc) and the 
closest feature point in the two-dimensional i-j-plane. 
20 The ttiird dimension can be added by equation (5), which is the same transformation 

as described m the equation for the k-direction (4). 

5^, = min{/i^ +(y (t -z))^a ^ z < AT} [Eq. 5] 

25 After completion of the EDT, the thickness of the cartilage for a given point (a,b,c) 

on the OCS equals the square root of Sabc- The x, y, and z position of each pixel located 
along the bone - cartilage interface can be registered on a 3D m^ and thickness values are 
translated into color values. In this fashion, the anatomic location of each pixel at the bone 
cartilage interface can be displayed simultaneous with the thickness of the cartilage in this 

30 location. 

Displaying the Degeneration Pattern 
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In an approach the cartilage thickness maps obtained using the algorifhm described 
above display only a visual assessment of cartilage thickness along the articular sur&ce. In 
anotiier ^pioach, in order to derive a true quantitative assessment of the location, size, and 
depth of a focal cartilage defect, one can use an itenitive ^roach comparing cartilage 
thickness of ndghboring pixels located along the bone cartilage intei&ce. 

For exazzq>le, assimiing an image resolution of 0.5 x 0.5 x 1.0 mm and an avmge 
thickness of the articular cartilage in the femoral condyles ranging between 2 to 3 mm, a 
25% decrement in cartilage thickness will be the smallest change that can be observed with 
most current imaging sequences. Therefore, for example, pixels along the bone - cartilage 
interface that demonstrate a decrease exceeding the smallest change observable on a given 
MRI pulse sequence, in ttiis example 25% or greater, in overlying cartilage thickness when 
conq>ared to cartilage thickness at the neighboring bone - cartilage interface pixels, can be 
used to define the margins of a focal cartilage defect Othar criteria can be employed to 
define a cartilage defect based on coiiq>arisons of neighboring pixels. For example, a fixed 
value can be used. If the difference in cartilage thickness between neighboring pixels 
exceeds the fixed value, e.g. 1 mm, the pixel where this difference is observed can be used 
to define the margin of the cartilage defect This comparison can be performed for each 
pixel located along the bone - cartilage interface for the entire data set This comparison is 
preferably performed in three dimensions. Pixels that demonstrate a decrease in cartilage 
thickness exceeding defined criteria but that are conopletely surrounded by other pixels 
fu lfilling the same criteria may not be considered to be part of the margin of the cartilage 
defect, but will typically be considered to lie inside the cartilage defect 

The invention provides for means for calculating the area covered by the cartilage 
defect Aoirtfiagp defect and the mean thickness of the cartilage in the region of the defect 
Dcartiiags defect as Well as the mean thickness of a defined area of surrounding normal cartilage. 
The thickness of the cartilage previously lost in the defect can be estimated then as: 



^cartilagBloss Dnormal cartilage - Dcaitilafie defect 



[Eq.6] 



Since the area A of the cartilage defect is known, ttie volume of cartilage loss can be 



conq>uted as: 



^csrtlage loss ~ Acsrtilage defect X D cartilage loss 



[Eq.7] 
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Turning now to Figures 22A and 22B, one can see a 2D MRI (3D SPGR) and 3D 
cartilage thickness map. In A, the 2D MRI demonstnites a fuU thiclmess cartilage defe^^ 
the posterior lateral femorl condyle (arrows). Figure 22B shows a 3D cartilage thickness 

5 map generated using a 3D BucMan distance transformation. The thickness of the articular 
cartilage is color encoded and displayed on a pixel-by-pixel basis along the 3D surfiice of 
the articular cartilage. The cartilage defect is black reflectixig a thickness of zero (arrows) 
(M: medial, L: lateral, S: superior, I: inferior). 

In Figures 23A - 23E, one can see the matching of 3D flhickness maps generated 

10 from MR images obtained with the knee in neutral position and in exterxial rotatioiL A. 
Sagittal baseline MR image (3D SPGR) with the knee in neutral position. B. Sagittal 
follow-up MR image of the same volunteer obtained two weeks later with the knee in 40 
degree external rotation (note the artificially widened ^>pearance of the femur resulting 
from the rotation). C. 3D thickness map generated based on baseline MRI in neutral 

15 positiorL D. 3D thickness map generated based on foUow-up MRI in external rotation (note 
segmentation error between condyles in trochlear region). E. Transformation of D into the 
object coordinate system of C. De^ite extreme differences in joint orientation between 
baseline and follow-up MRI scans and deq>ite segmentation errors, the thickness 
distribution on the matched foUow-i^ scan demonstrates great similarity with that seen on 

20 ttie baseliae scan in neutral position (in C). 

Having now described how to obtain an image of a cartilage of a joint, both with and 
witibout external reference markers; how to enhance the image by manipulating non- 
cartilage images, and creating and displaying 3-D images of the cartilage, i.c a 3-D map, 
certain aspects of the invention are apparent. 

25 One aspect is a method of estimating the loss of cartilage in a joint The method 

comprises 

(a) obtaining a tbre&^limensional map of the cartilage at an initial time and 
calculating tiie tiiickness or regional volume of a region thought to contain degenerated 
cartilage so mspped at the initial time, 
30 (b) obtaining a three-dimensional mzp of the cartilage at a later time, and 

calculating tiie thickness or regional volume of the region thought to contain degenerated 
cartilage so msqpped at the later time, and 

(c) determining the loss in thickness or regional volume of the cartilage between 
the later and initial times. 
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Preferably, this aspect of tibe mvention is directed to a volume of interest in the 
cartilage, ie., a region of the cartilage that includes a cartilage defect Such a defect may be 
the result of a disease of the cartilage {e,g., osteoarthritis) or the result of degeneration due 
to overuse or age. lliis invention allows a health practitioner to evaluate and treat such 
S defects. The volume of interest may include only the region of cartilage that has the defect, 
but preferably will also include contiguous parts of the cartUage suirounding the cartilage 
defect 

Another aspect of the invention is a method for assessing the condition of cartilage 
in a joint of a human, whidi method conqirises 
10 (a) electronically transferring an electronically-generated image of a cartilage of 

die joint from a transferring device to a receiving device located distant from 
the transferring device; 

(b) receiving the transferred image at the distant location; 

(c) convertirig Ae transferred image to a degeneration pattern of the cartilage; 
15 and 

(d) transmitting the degeneration pattern to a site for analysis. 

Another aspect of the invention is a method for detamining the volume of cartilage 
loss in a region of a cartilage defect of a cartilage in joint of a mamTnal The method 
conq>rises (a) detennining the thickness, DN, of &e normal cartilage near the cartilage 

20 defect; (b) obtaining the thickness of the cartilage defect, DD, of the region; (c) subtracting 
DD from DN to give the thickness of the cartilage loss, DL; and (d) multiplying the DL 
value times the area of the cartilage defect, AD, to give the volume of cartilage loss. The 
method is useful for situations wherein the region of cartilage defect is limited to the 
defective cartilage and preferably wherein die region of the cartilage defect includes a 

25 portion of the cartilage contiguous to the defect 

Alternatively, for step (a) the normal thickness of the defect area could be estimated 
It may be estimated from measurements of cartilage of other subjects having similar 
characteristics such as gender, age, body type, height, weight, and other £su:tors. It may be 
estimated from measurements of a similar 'normal" cartilage from another corresponding 

30 joint ie.g., if the ri^t knee has the defect, measure the normal left knee). It may have been 
measured at an initial time Ti when the cartilage was normal to provide a baseline. Other 
means of determining the normal thickness may be available to one of skill in the art Once 
ttie thickness Dn is obtained and the thickness Dp is obtained the two are subtracted to give 
the Dl. The Dl is multiplied by the area of the defect Ad to give the vohmie of cartilage 
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loss. By detennining the volume of cartUage loss at an initial Ti and again at a later time 
T2, one can determine the change in volume loss over time. 

Still another aspect of the invention is a method of estimating the change of a region 
of cartilage in a joint of a mammal over time. The method comprises (a) estimating the 

5 fliickness or widfli or area or volume of a region of cartilage at an initial time Ti, (b) 
estimating the fliickness or widfli or area or volume of flie region of cartilage at a later time 
T2, and (c) detennining flie change in flie thickness or widfli or area or votame of the region 
of cartilage between flie initial and flic later times. The mefliod is particularly usefiil for 
regions of degenerated cartilage or diseased cartilage. 

10 Still anoflier aspect of the invention is a mefliod of estimating flie loss of cartilage in 

a joint The mefliod comprises (a) defining a 3D object coordinate system of flie joint at an 
initial time, Ti; (b) identifying a region of a cartilage defect within the 3D object coordinate 
system; (c) defining a volume of interest around the region of the cartilage defect whereby 
the volume of interest is larger than the region of cartilage defect, but does not encompass 

15 the entire articular cartilage; (d) defining the 3D object coordinate system of the joint at a 
second timepoint, T2; (e) placing the identically-sized volume of interest into flie 3D object 
coordinate system at timepoint T2 using the object coordinates of the volume of interest at 
timepoint Ti; (f) and measuring any differences in cartilage volume within flie vohnne of 
interest between timepoints Ti and T2. 



20 



Therapeutic Planning, Devising New Therapies 



In anothCT embodiment of the invention, thickness of the articular cartilage can be 
estimated using an imaging test This imaging test can be an x-ray, ultrasound, CT scan or 

25 MRI scan. Thickness can be determined using a 3D Euclidiaa uistaaue transformation as 
well as other techniques feasible for this purpose. Thickness can be determined in selected 
regions or across the entire cartilage of a joint. Thickness can be detmnined in areas 
adjacent to diseased cartilage, in areas of diseased cartilage and in areas of normal cartilage. 
Furthermore, the curvature of the cartilage can be determined. For this purpose, flie 

30 curvature of the inner cartilage surface, i.e. the surface focing the subchondral bone, or the 
outer cartilage sur&ce, Le. the surface feeing the joint cavity, can be determined. Preferably, 
flie inner cartilage surfiice at the inter&ce wifli the subchondral bone will be used, since the 
outer cartilage surface may be subject to fraying, fissuring or more advanced stages of 
cartilage loss. Alternatively, the curvature of the subchondral bone can be detennined. In 
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this case, the cmvature of the subdiondral bone can s^e as an sq)proximation of the 
curvature of the articular cartilage. Curvature can be determined from an imaging test, 
typically an ultrasound, a CT or an MRI scan. Curvature can be detennined from a three- 
dimensional model of the cartilage. The three-dimensional model of the cartilage can be 
5 determined using the 3D Euclidian distance transformation mentioned above. Curvature can 
be detennined in selected regions or across the entire cartilage of a joint Curvature can be 
determined in areas adjacent to diseased cartilage, in areas of diseased cartilage and in areas 
of normal cartilage. 

Using information on thickness and curvature of the cartilage, a physical model of 

10 the surfeces of flie articular cartilage and of ttie underlying bone can be created. This 
physical model can be representative of a limited area within the joint or it can encompass 
the entire joint. For example, in the knee joint, the physical model can encompass only the 
medial or lateral femoral condyle, both femoral condyles and the notch region, the medial 
tibial plateau, the lateral tibial plateau, the eaUie tibial plateau, the medial patella, the lateral 

IS patella, the entire patella or the entire joint 

In another embodiment, the location of a diseased area of cartilage can be 
determined, for example using a 3D coordinate system or a 3D Euclidian distance 
transformation in combination with some of the techniques outlined above. In another 
embodiment of the invention, the anteroposterior, mediolateral or superoinferior dimension 

20 of an area or multiple areas of diseased cartilage can be d^ermined Furtheraaore, the area, 
depth and volume of a cartilage defect can be determined, for example using a 3D EucUdian 
distance transformation in combination with some of the techniques outlined above 

In one onbodiment of the invention, information on thickness of the cartilage, 
information on curvature of the cartilage, information on curvature of the subchondral bone 

25 ui iuTonnation on uac iocallon, dimensions, area, dq)th and volume of a defect or 
combinations thereof can be used to devise a treatment For example, the dimensions of a 
defect detennined in this maimer can be used to determine the dimensions of a cartilage 
transplant, a cartilage graft, a cartilage iiqilant, a cartilage replacement material, a cartilage 
scaffold or a cartilage regenerating material or any cartilage repair system. Additionally, the 

30 curvature of the inner cartilage surface or the subchondral bone can be measured and this 
infonnation can be used to detomine the shape of a cartilage transplant, a cartilage graft, a 
cartilage implant, a cartilage replaconait material, a cartilage scaffold or a cartilage 
regenerating matoial or any cartilage rq>air system. Additionally, the tiiickness of normal 
cartilage adjacent to the defect can be measured and the tibickness values measured in this 
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filshion cm be used to determine liie optimal thickness for a cartUage transplant, a cartilage 
graft, a cartilage implant, a cartilage replacement material, a cartilage scaffold or a cartilage 
regenerating material or any cartilage repair system. Alternatively, the thickness of the 
cartilage can be measured in the contralateral joint, e.g. the knee joint, in an area 
5 corresponding to the area of diseased cartilage in the affected joint Using any of these 
techniques or, preferably, a combination thereof an optimal fit can be achieved between the 
sunounding normal cartilage and a cartilage transplant, a cartilage graft, a cartilage implant, 
a cartilage replacement material, a cartUage scaflFold or a cartilage regenerating material or 
any cartilage repair system thereby minimizing incongruity at the joint surface and 
1 0 improving the ther^eutic result 

The invention provides for means to create a cast or a mold for shaping a cartilage 
transplant, a cartilage graft, a cartilage implant, a cartilage rq)lacement material, a cartilage 
scaffold or a cartilage regenerating material or any cartilage repair system. This can be 
generated using computer devices and automation, e.g. con^uter assisted design (CAD) 
15 and, for example, computer assisted modeling (CAM). 

In another embodiment, the invention provides for means to measure and visualize 
the curvature of tiie surfaces of cartilage and bone. In anotiier embodiment, the invration 
provides for means to compare tiie thickness and tiie curvatures of surfaces of a cartilage 
transplant and a transplantation site, a cartilage graft and a graft site, a cartilage implant and 
20 an implantation site, a cartilage replacement material and an implantation site, a cartilage 
scaffold and a cartilage defect, a cartilage regenerating material and an area of diseased 
cartilage, or a cartilage repair system and an area of diseased cartilage. 

The invention is usefiil for determining the shape, dimensions and thickness of a 
cartilage transplant, a cartilage graft, a cartilage implant, a cartilage replacement material, a 
25 cartilage scaffold or a cartilage regenerating material or any cartilage rq)aii system prior to 
treatment For example, the shape, dimensions and thickness of a cartilage transplant, a 
cartilage graft, a cartilage implant, a cartilage replacement material, a cartilage scaffold or a 
cartilage regenerating material or any cartilage repair system can be designed to follow the 
physical shape and thickness of the cartilage adjacent to an area of diseased cartilage 
30 determined using the imaging test 

The invention is applicable to a host of current and future treatments of arthritis 
inchiding but not limited to cartilage transplants, cartilage inq)lants, cartilage grafts, 
cartilage replacement materials, cartilage scaffolds, cartilage regenerating materials, auto-, 
alio- and xeno-transplants, osteochondral alio- and autografting, stem cell based repair 
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systems and transfer systems, and, prindpally, any other current and future treatments and 
devices for cartilage repair or regeneration. 

The exan^le described below shows one possibility how aspects of the invention 
can be implemented. It demonstrates one possible way how the invention can be practiced. 

5 It is in no way meant to limit the invention. One skilled in tiie art will easily recognize other 
means of practicing the invention. 

In a first step, the cartilage and bone contours can be segmented from the MR 
images using for example a modified live wire technique [Steines D, C3ieng C, Wong A, 
Berger F, Napel S, Lang P. CARS - Computer-Assisted Radiology and Surgwy, p. 578- 

10 583, San Francisco, 2000]. 

From the segmented data, a 3-dimensional surface representation can be created, 
which yields a triangular tesselation of the surface. For this calculation, a B-dimmsional 
Wang-Binford edge detector [Yan CH: Measuring changes in local volumetric bone 
density: new approaches to quantitative computed tomography ^ PIlD. thesis, 1998, Dept of 

15 Electrical Engineering, Stanford University] or the marching cubes algorithm [Lorensen 
WE, Cline HE. Comput Gr^h 1987; 21: 163-169] can be used This surfece representation 
can be imported into a CAD system, vMxAi is used to generate a physical model or a cast by 
means of rq>id prototyping techniques. 

The segmented data can also be used for measuring &e surface curvature at the 

20 sur&ce points. The curvature is calculated according to formula xx. If a:(a,b) -> R is a 
curve defined over the parameter interval (a,b) by a(t) = (x(t),y(t)). then the curvature k is 
given by [Gray A: Modem Differential Geometry of Curves and Surfaces. 1993; CRC 
Press]: 

(x'^(o+y'(0)^ 

25 For the digitized contours that result fix)m the segmentation, smooth derivatives for 

equation (8) can be obtained by convolution with differentiated Gaussian kemels [Woning 
M, Smeulders AWM. CVGff : hnage Understanding, 1993. 58(3): p. 366-382]. 

The curvature values can be calculated for each pixel on the segmented sur&ce in 
each slice. They can subsequently be color-mqiped onto a 3-dimensional rendering of the 
30 sur&ce for visualization purposes. 

For full curvature information this procedure can be repeated for a direction 
perpendicular to the imag ing plane. Of the remaining two main directions the one with the 
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lower degree of parallelism to the surface can be chosen, and reformatted sUces of the MR 
data set can be obtained for this direction. For instance, when curvature values for the 
femoral condyles are calculated from sagittal MR images of the knee, the data set would 
typically be reforaiatted for a coronal slicing plane. 

The procedure of segmentation and curvature calculation can then be repeated for 
the reformatted images, A second curvature map can be calculated, yielding complementary 
information to the first one. 

In Older to compare curvature values for different surfece patches, these can be 
manually or automatically registered, overlaying one surfece patch on top of the other. 
Corresponding curvature values that are calculated in the same directions can now be 
subtracted from each other, thereby yielding a measure of how well curvatures of two 
surfaces match. 

An example how aspects of the invention can be practiced clinically in a patient is 
given below. It demonstrates one possible way how the invention can be practiced. It is in 
no way meant to limit the invention. One skilled in the art wiU easily recognize other means 
of practicing the invention. 

A patient with arthritis of the knee joint is referred for an MRI scan. The MRI scan 
is performed using a cartilage sensitive MRI pulse sequence such as a fat saturated spoiled 
gradient echo sequence or a water selective 3D gradient echo sequence using a spectral 
^atial pulse. The MR images are transferred via a local network or, for example, the 
internet into a computer workstation. The computer workstation uses software to extract or 
segment the articular cartilage from the surrounding tissue. Such software can include snake 
algorithms, livewire algorithms, signal intensity based thresholding, or seed growing 
algorithms as well as any other technique useful for this purpose. The software can then 
generate a teee-dimensional map of cartilage thickness across the femoral condyles, the 
tibial plateau, or tiie patella. This can be achieved using a 3D Euclidian distance 
transformation. Additionally, the software can provide information on cartilage curvature or 
curvature of tiie subchondral bone as described above. Furttiermore, the software can 
deteraiine the location, dimensions, size, area, depth, or volume of areas of diseased 
cartilage. 

The information generated in this feshion can be used to generate a physical model 
of die area of diseased cartilage. For exanq>le, a bone replacement material can be formed 
with a CAD/CAM system using the above information. One of the surfaces of the bone 
replacement material can be shaped so that it matdhes the 3D ciuvature of the subchondral 
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bone subjacent to the area of diseased caitilage. AdditionaUy, the anteroposterior, 
mediolatOTl or siq)eroinferior dimensions of this surface of the bone replacement material 
can be such that it matches the dimmsions of flie area of diseased cartilage. Cartilage cells 
can be affixed to the bone replacement material and can be grown on the bone replacement 
5 material until the fliidmess of the resultant cartilage matches that of the ttuckness of the 
cartilage adjacent to the area of diseased cartilage measured on the 3D cartilaga feickness 
map. Alternatively, a layer of cartilage of known thickness can be applied to the bone 
replacement material whereby the thickness can be diosen to match the thickness of the 
cartilage adjacent to the area of diseased cartUage measured on the 3D cartilage thickness 
10 m^. 

Alternatively, an artificial non-human material with properties similar to cartilage 
can be applied to the bone replacement material whereby the thickness of this mat«ial can 
be chosen to match the thickness of the cartilage adjacent to flie area of diseased cartilage 
measured on the 3D cartilage thickness m^. 

15 Alternatively, cartilage can be grown on a mold matching the curvature of the 

subchondral bone in an area of diseased cartilage whoreby the dimensions of the surface of 
the mold on which the cartilage is grown matches the dimensions of an area of diseased 
cartilage. Cartilage can then be grown on the mold until its thickness matches the thickness 
of cartilage adjacent to the area of diseased cartilage as measured, for example, on a 3D 

20 cartilage thickness m^. At this point, for example, an orthopedic surgeon can excise the 
area of diseased cartilage and can implant the cartilage or cartilage replacement material. 
Since the curvature of the cartilage or cartilage replacement material matches that of the 
underlying subchondral bone and since the thickness of the cartilage or cartilage 
replacement material matches that of the cartilage adjacent to the area of excised diseased 

25 cartilage, normal or near normal j oint congniity can be achieved with a resultant decrease in 
wear on the inq)lanted cartilage or cartilage replacement material and also a decrease in 
wear on the adjacmt cartilage or the cartilage of the opposing joint surfece. 



30 



Display of Biochemical Information 

In addition to providing a 2D or 3D rq>resentation of flie morphological properties 
of cartilage, the invention provides for techniques to represent one or more biochemical 
componoits of articular cartilage. 
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A biochemical conqx>nent includes, but is not limited to, glycosaminoglyDan, water, 
sodium, or hyaluronic add Biochemical data can be generated with other magnetic 
resonance based techniques including the use of signal intensity measurements, relaxation 
time measurements, paramagnetic and oflier contrast media and sodium raAer than proton 
5 MR imaging. Other imaging tests such as positron onission tomography scamiing can also 
be used for tins purpose. Thus, one aspect of this invention is a method for providing a 
biochemically-based nu^) of joint cartilage. The method con^rises 

(a) measuring a detectable biochemical conq)onent throughout tiie cartilage, 

(b) determining the relative amounts of the biochemical component tiiroughout 
10 the cartilage; 

(c) mapping the amounts of the biochemical component through the cartilage; 

and 

(d) determining the areas of cartilage deficit by identifying the areas having an 
altered amount of the biochemical component present 

15 

Once a map is obtained, it can be used in assessing the condition of a cartilage at an 
initial time and over a time period. Thus, the biochemical map may be used in the method 
aspects of the invention in a maimer similar to the cartilage thickness m^. 

For example, one aspect is a method of estimating tixe loss of cartilage in a joint 
20 The method comprises 

(a) obtaining a relaxation time or biochemical map of the cartilage at an initial 
time and analyzing the relaxation time or biochemical content of a region thought to contain 
degenerated cartilage so mq>ped at the initial time, 

(b) obtaining a relaxation time or biochemical map of the cartilage at a later 
25 time, and time analyzing the relaxation time or biochCTtiical content of the region thought to 

contain degenerated cartilage so mappcA at the later time, and 

(c) determining the change in relaxation time or biochemical content of the 
cartilage between the later and initial times. 

Preferably, this aspect of the invention is directed to a volume of interest in the 
30 cartilage, i.e, a region of ttie cartilage tiiat inchides a cartilage defect Such a defect may be 
the result of a disease of tiie cartilage (e^., osteoartiiritis) or tiie resutt of degeneration due 
to overuse or age. This invention allows a health practitioner to evaluate and treat such 
defects. The volume of interest may include only tiie region of cartilage that has the defect. 
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but preferably will also include contiguous parts of tbe cartilage surrounding the cartilage 
defect 

As discussed herein before, another aspect of the invention is a method for assessing 
the condition of cartilage in a joint using a relaxation tune or the biochemical map. The 
5 m^od comprises 

(a) electronically transferring an electronically-generated relaxation time or 
biochemically based image of a cartilage of tiie joint from a transferring 
device to a receiving device located distant fiom the transfecring device; 

(b) receiving the transferred image at the distant location; 

10 (c) converting the transferred image to a degemeration pattern of the cartilage; 

and 

(d) transmitting the degeneration pattern to a site for analysis. 

Another aspect of the invention is a method for detennining the change of 
biochemical content in a region of a cartilage defect of a cartilage in joint of a mammal. 

15 The method comprises (a) determining the biochenucal content (BCh) of tiiie normal 
cartilage near tiie cartilage defect; (b) obtaining the biochemical content of flie cartilage 
defect (BCd) of tiie region; and (c) subtracting BCo j&om BCn to give tihie value of ttie 
cartilage change, BCd. The method is useful for situations wherein the region of cartilage 
defect is limited to the defective cartilage and preferably wherein the region of flie cartilage 

20 defect includes a portion of the cartilage contiguous to the defect 

Alternatively, for step (a) the normal content of tiie defect area could be estimated. 
It may be estimated finom measurements of cartilage of other subjects having similar 
characteristics such as gender, age, body type, height, weight, and other factors. It may be 
estimated from measurements of a similar 'normal" cartilage fiom another corresponding 

25 joint (e.g., if the rigjit knee has the defect, measure the normal left knee). It may have hcen 
measured at an initial time Ti when the cartilage was normal to provide a baseline. Other 
means of determining the normal contrat may be available to one of skill in the art Once 
BCn is obtained and BCd is obtained the two are subtracted to give the A. By determining 
the change of content at an initial Ti and again at a later time T2, one can determine the 

30 change in biochemical content over time. 

Once a relaxation time or biochemically-based m^ is provided, morphological 
m^s of articular cartilage obtained with MR imaging can be superimposed, merged or 
fused with the biochemical map or data. Several difiTerent techniques can be applied in order 
to superimpose, merge, or fuse morphological data with biochemical data. For example, 2D 
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or 3D morphological data of articular cartilage can be acquired with the same object 
coordinates as the biochemical data. Morphological data and biochemical data can then be 
easily displayed simultaneously using different colors, opacities, and or gray scales. 
Alternatively, 2D or 3D morphological data or articular cartilage can be acquired with 

5 different object coordinates as the biochemical data. In this case, a 3D surface registration 
can be appUed in order to superimpose, merge, or fuse the morphological data and the 
biochemical data. As an ahemative to 3D object coordinates, anatomic landmarks can be 
used to register the morphological data and subsequently the biochemical data in a 3D 
object coordinate system. 3D object coordinate systems can flim be matched by matching 

10 the landmarks obtained from the morphological data with those obtained from the 
biochemical data. 

Thus, another aspect of this invention is a method for assessing the condition of a 
subject's cartilage in a joint, the method comprises obtaining a three dimensional 
biochemical representation of the cartilage, obtaining a morphological representation of the 

15 cartilage, and mergmg the two representations, and simultaneously displaying the merged 
representations on a medium. The merged representations are then used to assess the 
condition of a cartilage, estimate the loss of cartilage in a joint, determining the volume of 
c^Iag^ loss in a region of cartQage defect, or estimating the change of a region of cartilage 
at a particular point in time or over a period of time. One can see that similar stq)s would 

20 be fi)llowed as spelled out for the use of a thickness m^ or biochemical vazp. 

Simultaneous diq)lay of morphological data with biochemical data provides a useful 
tool to assess longitudinal changes in morphology or articular cartilage and biochemical 
composition of articular cartilage, for example during treatment witti chondroprotective and 
chondroregenerative agents. 

25 Part of the unique aspect of tiiis technology is that it lends itself to assessment of a 

patient from a distant position after an image is taken of the joint under evahiation. Thus 
one aspect of tiiis invention is a method for assessing the condition of cartilage in a jomt 
from a distant location. The method comprises 

(a) electronically transferring an electronically-generated image of a cartilage of 
30 the joint from a transfenring device to a receiving device located distant from the 

transferring device; 

(b) receiving the transferred image at the distant location; 

(c) converting the transferred image to a degeneration pattern of the cartilage; 
and 
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(d) transnuttmg ttie degeneration pattern to a site for aaaiysis. 
The degeneration pattern includes a measure of cartilage thickness or regional cartilage 
vohnne. 

The electronically generated image of the cartilage preferably is an MR image and 
S die degeneration pattern can be displayed as a three-dimensional image as a thickness 
pattern, a biochemical content pattern or a merged thickness biochemical pattern. The 
electronically generated image is transmitted via Dicom, using the international standards 
for transmission of such images. 

Another aspect of the invention is a kit for aiding in assessing the condition of 
10 cartilage in a joint of a mammal, which kit comprises, a software program, which that when 
installed and executed on a computer reads a cartilage degeneration pattern presented in a 
standard gr^hics format and produces a computer readout showing a cartilage thickness 
map of the degenerated cartilage. 

The software can be installed in a PC, a Silicon Gr^hics, Inc. (SGI) conq)uter or a 
15 Macintosh computer. Preferably, the software calculates the thickness or regional volume 
of a region of degeneration of the cartilage which does not include the entire volume of the 
articular cartilage. 

THE MOVEMENT PATTERN 

20 

To acquire a movement pattern of a joint in accordance with this invention, one 
obtains an internal image of the bones in a joint, preferably using MRI techniques, and 
obtains an external image of the bones in motion. The images are correlated, preferably 
through the xise of external marker sets, to give a pattern that shows a static or moving 
25 condition. The correlated images are then displayed and the relation between the movement 
and degeneration patterns is determined 
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Obtaining An Internal Image of Joint with Bones 
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To obtain an internal miage of a joint with the associated bones, one preferably uses 
MRI techniques that provide an image of the bones on either side of the joint Here, it is 

5 important to use &e imaging technique that gives the best image of the bones and how they 
interact Because the internal image of the bones can be combined with tiie image of the 
bones obtained by external measuronents, it is particularly useful, and therefore preferred, 
to use external reference markers that can be similarly-positioned to the markers used in 
obtaining the external measurements. The external markers can be placed at any landmarks 

10 about the joint of interest At least three markers are used for each limb being imaged 
Preferably the markere will be made of a material that not only will be detected by MRI 
imaging techniques, but also will be detected by extemal imaging techniques. The markers 
will be associated with a means to aflSx them to the skin and preferably have an adhesive 
portion for adhering to the skin and a detectable entity that will show up on the MRI image. 

15 The preferred MRI imaging technique useful for obtaining an internal image is a 

spoiled 3D gradient echo, a water selective 3D gradient echo or a 3D DEFT sequence, A 
further discussion may be found hereinbefore or in the 2"*^ Edition of Brown and Semelka's 
book entitled •'MRI Basic Principles and Applications," 

Once an MR image is obtained the image is manipulated to enhance the image of the 

20 bones. Procedures similar to those discussed hereinbefore for cartilage may be used, but 
modified for application to bone images. 

Creating Three-Dimensional (3D) Image of Joint/Bones 

25 Three-Dimensional Geometric Model Generation 

After the 3D image of a joint with bones, the set of segmented two dimensional MR 
images can be transformed to a voxel representation inside AVS Express (Advanced Visual 
Systems, lac, Waltham, MA). Every voxel has a value of zero if it is not within an object 
30 of interest or a value ranging fiom one to 4095, depending on the signal intensity as 
recorded by the 1.5 T MR. An isosurface can then be calculated that corresponds tp the 
boundary elements of the region of interest A tesselation of this isosur&ce can be 
calculated, along with the outward pointing normal of each polygon of the tesselation. 
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These polygons can.then be writtoi to a file in a standard giqilucs fonnat (Virtual Reality 
Modeling Language Version 1.0). 

As discussed hereinbefoie, tbe use of lefaence maikers on die skin around the joint 
and Qie bones can provide an image that can later be matdied to die reference markers for 
die cartil^ image and the bone images obtained fiom extenud measuranents. 

Altemativdy, a semi-aatomated, 3D sur&ce-based registration technique that does 
not require die use of an external frame or fiducial markers can be used. This 3D surface- 
based registration technique can be used to match the anatomic orientation of a skeletal 
stnicture on a baseline and a follow-up CT or MRI scan. We extended a robust and accurate 
2D edge detector (Wang-Binford) to 3D. This detector is described hereinbefore. 

A registratitni technique for the femoral condyles and the tibial plateau is shown in 
Hgure 10. It shows an example ^ere 3D surfaces of tibe femoral condyles were extracted 
from two differently oriented TUwei^ted spin-echo MRI scans (baseline A and foUow-i^ 
B, respectively) obtained in the same patient m neutral position (A) and in 40 degree 
external rotation (B). The 3D surfaces were used to derive a coordinate transformation 
relating the two scans. Fig. IOC demonsdates the use of the derived transformation to re- 
register scan B m the object coordinate system of scan A. Such a transformation relating 
two Tl-wei^ted scans can then be used to register DEFT cartilage-sensitive scans that are 
acquired in fihe same req)ective orientations as the A and B Tl -weighted scans. 

We performed the registration usmg a Sun Sparc 20 workstation wifli 128MBytes of 
memory. The surface detection algorithm exfracted ^jproximately 12,000 surface patches 
fiom each data set The surface extraction and registration routines took about 1 hour in 
total. 

Since the algorithm for 3D surface registration of the femoral condyles also 
computes the surface normals for the medial and lateral femoral cond>1es on a pixel-by^ 
pixel basis, it can form the basis for developing m^s of cartilage thickness. Fig. 11 shows 
an example of a 2D mq) of cartilage thickness derived from tbe surface normals of ttie 
lateral femoral condyle. Figure 1 1 A shows a proton density fast spin-echo MR image that 
demonstrates a focal cartilage defect in the posterior lateral femoral condyle (black arrows). 
White arrows indicate endpoints of thickness map. Figure 1 IB is a 2D cartilage thickness 
map that demonstrates abrupt decrease in cartilage thickness in the area of the defect 
(arrows). The A thickness between neighboring pixels can be used to define the borders of 
the cartilage defect Note difiiise cartilage thinning in area enclosed by the astericks (*). 



48 



10 



WO0M2014 PCr/USOl/28680 

In anolher embodiment, cartaage sensitive images can be used instead of Tl- 
wdghted or T2-weighted scans and the surface match can be performed based on the 
cartilage contour. 

Alternatively, anatomic landmarks present on both baseline and follow-up scans can 
be used to match the data obtained during the basehne and those obtained during the follow- 
up scan. Another alternative for matching the baseline and the follow-up scan includes the 
use of external or internal fidudalinaikers that can been detected with ^ In that 

case, a transfonnation is performed that matches the position of the markers on the follow- 
up scan with the position of the markers on the baseline scan or vice versa. 

Obtaining An External Image of Joint/Bones 



Before merging or superinqwsing morphological maps of articular cartilage obtained 
by MR imaging with biomechanical data, one must obtain the biomechanical data. Such 

1 5 biomechanical data include, but are not limited to, estimations of static loading alignment in 
standing or weight-bearing position and lying or non-weigjht-bearing position, as well as 
during joint motion, e.g., the movement of load-bearing pathway on the cartilage in the knee 
joint during gait Biomechanical data may be generated using theoretical coiiq>utations, 
based on data stored in a database that can be accessed by calling up and screening for 

20 certain characteristics. Alternatively, gait analysis may be performed for an individual and 
data obtained during gait analysis may be merged or fused with morphological MRI data. 
Morphological data and biomechanical data can then be easily displayed simultaneously 
using diflfeent colors, opacities, and or gray scales. Additionally, the load-bearing pathway, 
for example around a cartilage defect, can be plotted or superimposed onto morphological 

25 maps. 

Preferably, reference markers or fiducial markors can be ^plied to the external 
surface on the skin overlying flie joint These markers adhere to the skin are typically made 
of materials that can be delected with MRI and that can be used to register joint motion 
during biomechanical analysis^ e.g. gait analysis. These markers can then be used to 
30 correlate the morphological with the biomechanical data. 

Simultaneous display of morphological data with biomechanical data provides a 
useful tool to assess the load pathway ^plied to articular cartilage and inside and around 
cartilage defects. Estimation of load pa&way applied in and around a cartilage defect can 
be used to assess a cartilage defect and to guide the choice of therapy, e.g. treatment with 
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chondioprotective or chondroregmerative agents, osteochondral aUografting. cartilage 
transplantatioii, femoral or tibial osteotomy, or joint replacement surgery. 

Recordluig Static Joint/Bones and Joint/Bones in Movement 

In obtaining an external image of the bones on either side of a joint, one must record 
a static image as well as a moving image of flie subject joint and bones. For analysis of the 
knee joint, gait analysis techniques have been shown to be very effective in generating 
accurate, reproducible data on the six degree of fieedom motion of the knee. The motion of 
the knee joint can be quantified in terms of flexion, rotation and displacement. Fidelity in 
the dynamic visualizations of subject specific MR generated knee geometry and subsequent 
contact surface determinatian call for a high degree of accuracy for the motion capture 
pration of the studies. 



Gait Andtysis Activities 

In performing a gait analysis, a subject is tested standing still, laying down, walking 
or running on a level surfece, flexing a leg in a standing position, ascending and descending 
stairs, flexing the leg in a seated position, and the like. The level walking measurements can 
inchide, but is not limited to, six stride cycles for each side over a range of walking speeds. 
The subject can be instructed to walk at a comfortable speed (normal), slower than normal 
and faster than normal. TypicaBy, this protocol produces gait measurements over a range of 
walking speeds. The standing and laying portions of the protocol can be used in the cross 
registration to the MR data. The instrumentation preferably includes, at least a two camera, 
video-based opto-electronic syston for 3-D motion analysis, a multi-component force plate 
for measuremait of foot-ground reaction force and a computer system for acquisition, 
processing and analysis of data. 



Anatomic Coordinate Systems 

Cuncaatly, tfie anatomic coordinate systems are defined through bony landmarks 
which can be identified thrott^^ pa^ation. To describe flie motion of the underlying bones 
in terms of the global coordinate system a subsrt of ttie markers in a point chister technique 
(discussed hereinafter) are refwoiced to bony landmarks on the femur and tibia. Tedmiques 
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described previously by Hopenieid and Benedetti can be used to locate these bony 
landmarics. The anatomic coordinate .systems used can be similar to that previously 
described by LaFortune with the exception of the origm of the femoral coordinate system. 
For the thi^ segment, a coordinate system is located in the femoral condyles. The femoral 

5 condyles medial(M)-lateral(L) axis (Fig. 12) runs through the trans^icondylar line (a line 
drawn between the medial-lateral femoral epioondyles). The midpoint of this axis is the 
origin. The inferiorCO-superior(S) axis runs parallel to the long axis of the femur, passing 
thiou^ the midpoint of tfie trans-epicondylar Hne. The anterior(A)-postcrior(P) axis is the 
cross product of the medial-lateral and inferior-superior axes. The final position of the 

10 inferior-siq)erior axis is made orthogonal to the anterior-posterior and medial-lateral axis 
through a cross product operation (Fig. 13). For the shank segment, the tibial coordinate 
system begins with the medial-lateral axis running through the most medial and lateral 
edges of the plateau. The inferior-superior axis is perpendicular to flie medial-latCTal axis 
passing through the tibial eminence. The anterior-posterior axis is the cross product of the 

1 S medial-lateral and inferior-superior axes. 



Placement of Markers Prior to Activity 



In assessing a joint, the lower extremity can be idealized as 3 segments with six 
20 degree-of-freedom joints at the knee and ankle. For the mobile activities described above, 
at least 3 markers per segment are used. Figure 14 shows 21 passive retro-reflective 
markers located on the leg: some at bony prommences (greater trochanter, lateral malleolus, 
lateral epicondyle, lateral tibial plateau), some clustered on the thigh and shank (Fal-3,11-3, 
Fpl-3; Tal-3, Tll-13). Additionally, two markers are placed on the foot at the lateral aspect 
25 of the calcaneus and base of the fifth metatarsal and one on the pelvis at theiliac crest). 
During the static activities (standing still, laying down) 7 additional markers are placed: 
medial malleolus, medial epicondyle, medial tibial plateau^ medial and lateral superior 
patella, medial and lateral inferior patella. The eight markers nearest to the knee joint can 
be filled with Gadolinium, and can be be replaced at these same locations prior to the MR 
30 images (Fig. 1 5). The locations can be marked with a non-toxic marker-p^. 

Reference Database 
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H,e reference database is typically a compendium of demogi:9,hic and motion 
analysis data for aU subjects wbose data has been processed by a central processing s.te. 
IMS database can contain fields describing each of the subject's name. age. hei^t. weight, 
injury types, orthopedic medical history, other anatomic measurements (thi^ length, shank 
lengd, shoe size. etc.). Ihe database can also contain the results of any and all gart analysis 
nm on these patients. This can include, for all activities tested (walk. run. jog. etc.). a 
number of peak valves (peak knee flexing, peak hip adduction movement; to^ut. angle, 
etc), along with the motion trajectories of the hmb segments whUe the subjects are 
perfoiming different activities. 

in order to obtain a typical motion profile, the sex. age. height, weight, hmb length, 
and type of activity desired can be entered as an average mto the database. The database 
searches for a set of subjects most closely watching the input average. From this set of data, 
atypicalmotionpattemisdistilledandadatasetisoutput llrisdatasetcaninctode.overa 
timeintervalthemotion characteristics: hip /knee /ankle /flexion /extension angles. knee 
/hip/ankleadd«ction/abductionangles.movement,stridelength,cadence.etc. Thisdata 

can then be used to drive an animation of the motion of the desired joint 



Process Image of Joinl/Bones 

20 Calculation of Limb Segrnent Parameters 

Each hmb segment (thigh, shank and foot) can ideaUzed as a rigid body with a local 
coordinate system defined to coincide with a set of anatomical axes (the assumption of 
rigidity is dropped m calculating tiie location of the femur and tibia). The intersegmental 
25 moments and forces can be calculated fiom the estimated position of tiie bones, the ground 

tcactionforcemeasurements.andthehmbsegmentmassrmertiaproperties. Themomentat 
knee can be resolved into a coordinate* system fixed in a tibial reference system with 
axes definmg flexion^xtension. abduction-adduction, and intemal-extemal rotation. 

This approach provides results in a range of patients in a highly reproducible 
30 mamier. TypicaBy the magnitudes of the moments are dependent on walking speed. To 
contiol for foe influence of walking speed, foe walking speed closest to 1 meter/second is 
used, nris speed is wifoin foe nomud range for foe type ofpatients for which foe invention 

is particularly usefol. In addition to foe gait trial collected at 1 meter/second, self-selected 
speeds can also be evaluated to give a good correlation between gait-quantitative estimates 
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of joint load lines and o&er measures when using self-selected speeds. In order to test 
patients under their typical daily conditions, medications should not be modified prior to 
gait analyses. 

5 Point Cluster Technique 

The Point Cluster Technique (PCT) movanent analysis protocol is an extensible and 
accurate approach to bone motion estimation. Basically, a number of retro-reflective 
markers retro-reflective material firom 3M, Corp.) are attached to each limb segment 

10 under observation. Multiple video cameras can acquire data with the subject standing still 
and during activities of interest An over-abundance of markers on each limb segment is 
used to define a cluster coordinate system, which is tied to an anatomically relevant 
coordinate system calculated with the subject at rest 

The standard PCT transformations are described below. In short, each marker is 

15 assigned a unit mass and the inertia tensor, center of mass, principal axes and principal 
moments of inertia are calculated. By treating the center of mass and principal axes as a 
transformation, local coordinates are calculated Another set of coordinate systems is 
established; limb segment specific anatomic landmarks are identified through palpation and 
a clinically relevant coordinate system defined For the femur and tibia, Hxese anatomic 

20 coordinate systems are shown in Fig. 12. The transformation fiom the reference cluster 
coordinate system to the anatomic coordinate system is determined with the subject at rest 
by vector operations. During an activity, the transformation fiom the global coordinate 
system to the cluster coordinate system is calculated at each time step. To place the 
anatomic cooixlinate in the global system during the activity, the reference coordinate 

25 system to anatomic system transformation is sqiplied, followed by the inverse global 
coordinate system to cluster coordinate system transformation for each time step. 

In the Point Cluster Technique (PCI) a cluster of N markers can be placed on a limb 
segment of ttie subject The location vector of each marker in the laboratory cdordinate 
system is denoted as G(i,t) for marker i, (i = 1 A - JN) at time t, to ^ t ^ tf. A unit wdgjit 

30 &ctor is assigned to each marker for the purpose of calculating &e center of mass, inertia 
tensor, principal axes and principal moments of inertia of the cluster of markers. The 
cluster center of mass and principal axes form an orthogonal coordinate system described as 
the cluster system. The local coordinates of each of flie markers relative to this coordinate 
system are calculated. Then 
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Ga.t) = c(t) + m • UM) =Te (t) • m) 



i = l ...N 



wh^ G(t) is a matrix of aU marker coordinate vectors. C(t) is the center of mass of G(t) 
5 E(t) is the matrix of dgenvectors of the inertia tensor of (Kt). and U^^^ 

coordinates of marker i. 

Tl^ese markers are observed by optoelectronic means while the subject performs 
activitiesandwhilestandingcompletelystiUinareferenceposit^^^ With the subject m 
this same reference position, a subset of the madcers is observed relative to the underlymg 
10 bonesbyothertechniques,whichmightincludex-rays,Crscan,orpalpation. 

Themeasuredmarkerlocationsaredefinedwithrespecttothennobservablelo^^^^ 

. and orientation of die bone by 
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20 



G(i.t) = P(t) + 0(t) • R(i.t) = Tb (t) • R(i.t) 



i = l...N 



where P(t) is the location and 0(t) is the orientation of a coordinate system m 
bone and R(i.t). also unobservable. are the trajectories of the marieers relative to the 
underlying rigid body coordinate system at timet The bone and cluster systems are each 
orthogoiud systems, related bylhe rigid body transformationTbcO): 



LCi.t) = Tbe(t)«R(i.t) 
substituting and eliminating R(i,t) yields 
25 Tb(t) = Tc(t)»Teb(t) 

To maintain physical consistency, Te^t)= W must be the inertia tensor 
dgendecomposition transfimnation of R(i.t). Once R(i.t) are specified. T^f) and 
subsequently Tb(t) are calculable. 

30 
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From these equations one can also relate flie global coordinate systan with respect 
to a limb segment system. As an example of how these systems can be used to describe 

5 joint motion, one can consider the tibio-femoral joint The motion that is of interest is how 
the femoral condyles move with respect to the tibial plateau. This is done by first defining a 
set of coonlinate axes in die femoral condyles and the tibial plateau. 

A coordinate system is located in both the femoral condyles and the tibial plateau. 
The femoral condyles medial-lateral (ML) axis runs through the trans-epicondylar line 

10 (TEL), a line drawn between the ML femoral epicondyles. The midpoint of this axis is the 
origm. The inferior-superior (IS) runs parallel to the long axis of the femur, passing through 
the midpoint of the TEL. The anterior-posterior (AP) is the cross product of the ML and IS 
axes» The tibial coordinate system begins with the ML axis running through the most 
medial and lateral edges of the plateau. The IS axis is perpendicular to the ML axis passing 

15 through the tibial eminence. The AP axis is the cross product ofthe ML and IS axes. These 
are known as the anatomic coordinate system (A(t)tfug)i, A(t)8han]c)- 

Relating the cluster system to the anatomic coordinate system is done by use of 
another transformation matrix. This is done by relating the thigh cluster to a cluster of 
madcers, a sub cluster, that is related to the femoral condyles and femur (cluster to anatomic 

20 transformation). 

R(t)ttagh = U(t)flrig,i A(t)thi8i, 
The tibia has a similar transformation matrix. 

25 

R(t)sh«nk = U(t)shank A(t)steric 

Therefore, firom a cluster of maikers in the global system, motion ofthe femur with 
respect to the tibia can be detemiined by: 

30 

TS(t) = A(t)ilug^ • G(t)ttugh • R(t)shank • A(t)rf«,k 

Here TS(t) is the motion ofthe thigh with respect to the shank. 
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Angtes aic calculated by a projection angle system, an axis from the femoral 
anatomic system and one from the trT,ia are im,jected onto a plane in the .^^^ 
system. For example, flexion/extension can be detemrined by projecting the IS axis of the 
femur and tibia onto the sagittal plane (AP-IS plane) of the tibia. 

Validation of the Point Ouster Technique 

Ttc point Chester technique was evaluated as a method for measuring in vh« limb 
segment movement from skin placed marker clusters. An Dizarov device is an external 
fcrture ^ere 5 mm diameter pins are placed directty into the bone on either side of a bony 
defect H,e rigid external struts afiBxed to these pins fomi a rigid system fixed m flie 
underlyingbone. Two subjects were tested with Bizaxov fixation devices. One subject had 
the Dizarov device placed on the femur and second subject had the device placed on the 
tibia. Each subject was instrumented with point clusters placed on the flugh and shank 
segment In addition, markers were pW on the Dizarov device to establish a system fixed 

in ttie underlying bone. 

•me relative angular movement and translational displacement between the system 
affixed in the bone and the point cluster coordinate system were calculated whUe ascending 
a 2a.mi step (Step Test). Angular changes between the three orthogonal axes fixed m the 
bone versus three axes in the point cluster were calculated. The average difference over the 
trials for three axes were 0.95 ± 1.26. 2.33 ±1.63. and 0.58 ± 0.58 degrees. Similarly, the 
average error for the distance between coordinate systems was 0.28 ± 0.14 cm. Hie second 
subject with the Dizarov device placed on the femur could not perform the Step-Test, but 
was able to perform a weight-bearing flexion test where his knee flexed to approxmiately 
20" from a standing position. The average change between the coordinate origin was 0.28 ± 
0.14 cm. The changes m axis orientation were 1.92 ± 0.42. 1.11 ± .69 and 1.24 ± 0.16 
degrees. 

Tbt simultaneously acquired motion for a coordinate system embedded m bone 
(Dizarov system) and a set of skin-based markers was compared. At every time instant the 

location and orientation of tiie Dizarov system, the rigid body model skin marker system, 
andtheintervaldefomiationtechniqueskinmaikersystemweredetemuned. Tbechangem 
the transfi>rmation from the Dizarov system to one of the skin maricer systems over time IS a 

measure of the deformation unaccounted for in the skin marker system. 
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The interval defonnation technique produced a substantial improvement in the 
estimate of the location and orientation of the underlying bone. For perfectly modeled 
motion fliere would be no illative motion between the Dizarov system and the skin marker 
system over the time interval. The change in the transformation fix>m the Ilizarov system to 

5 flie skin maiker systems are shown in Figures 14 and 15, for location and orientation 
respectively, for both a rigid body model and the interval deformation technique. For tfiis 
single data set, the location error was reduced from 7.1 cm to 2.3 cm and the orientation 
error ftom 107 degrees to 24 degrees, with the error summed over the entire time interval. 
The subject performed a 10 cm step-up; the maricer defonnation was modeled as a single 

10 Gaussian function. 

Deformation Correction 

There are a number of algorithmic ahematives available to minimize the effects of 
15 skin motion, soft tissue deformation, or muscle activation that deform the externally applied 
markers relative to the underlying bone. The Point Ouster Technique decreases the effects 
of maiker movement relative to the underlying bone throng averaging. If more correction 
is required, one of a number of defonnation correction techniques may be added hi order 
of increasing computational complexity and defonnation correction ability, these are rigid 
20 body linear least square error correction, global optimization correction, anatomic artifact 
correlation correction and interval deformation correction. 

An overview of the Interval Defonnation Correction Technique is given below. In 
short, the technique provides a TnaYimnm likelihood estimate of the bone pose, assuming 
that each maiker on a limb segment deforms relative to the underlying bone in some 
25 functional form. The technique parameterizes these functional forms and then performs a 
multi-objective non-linear optimization witii constraints to calculate these parameters. This 
is an extremely computationally intensive technique, with the current instantiation of the 
algorithm requiring 6-8 hours per limb segment of running time on 266 MHz Pentium 2 
computer. 

30 
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Interval Deformation Technique 

Since Tc can be calculated diiectty ftom the global coordinates of the mariners, the 
remainder of this development only exanrines the determination of R(U) and subseqaently 
T.^t) For1hisreducedprobl«n.theii^utdatai8thelocalcoordinatesinthedn^ 
Uit)f6ralli.T.<t^tr. It can be assmned that eadx marker has some parameteru^ 
tr^ectory. d(a,„ t). relative to the underlying bone at each time step, ^th independent and 
identically distributed noises v(ij,t) 



10 



Rj(i.t) = d(aij.t) + v(ij,t) j = l-3 i ^"^ 



15 



or, equivaloitly 

R(i,t)=F(ai,t) + va,t) » = 1 



where a« is a vector of parameten, for marker i, ordinate j; ai is a vector of 
panmieten; combining an of the parameter for an of the ordinates of marker L Ttente 

estimate of the data, M(i,t), can be given by 
20 M(i,t)=Tbc(t)»R(i.t) 

Without ferther restrictions the problem is indeterminate, as the locations of the 
maAersinthebonesystemR(i.t)areneverobservablewiththeopto^lectronicsystem^ The 

indetemrinate problem can be converted to a cW-squared estimate pn>bl«n through a senes 
25 ofsteps. Anobservationoflbetndyunobservablesatthetimeboundariesisinferredith^ 

is, it is assumed that T*(t^ to) and Tcb(t^td are observed. The value of Tcb can be 
selected dependingontheactivitybeingstudied. For example, consider the step up activity, 
wherethesubjectstartsandstopsintherefaenceposition. For this activity the body is not 
deforming outside the estimation interval; that is. the maikers are not moving with respect 
30 tothebone: 

Tcb(t<to) = Td,(t=to) and Tcb(t>td=Td,(td. 
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It can now be assumed that the noise functions v(i, j, t) are nonnal distributions with 
individual standard deviations 0(1, j, t), the probability P(i j.t) of the data for ordinate j, 
maricer i, time t being a realization of the stochastic process is given by: 



nuj,t)^^ir-^ir—^^ )) 



Provided the noise functions vp, j, t) are indq)endent of each other, flie probability 
of the entire data set being a realization is aproduct of each of the individual probabilities; 

10 Pii,j,t) « n n n «^ (-2< — ^fttt) — ^ ^ 

Maximizing this probability can be equivalent to mi nimizin g the negative of its 
logarithm, yielding the fiamiliar chi-square criteria. As an intennediale step the following 
error matrices can be defined: 



15 



x(,^,-).xM^-i^MtMzM&m-f i=,.N j-i..3 



and seek a which in some sense minimizes X(a), a matrix whose elements represent 
20 the eiror over the entire time interval for each ordinate of each marker. If the normal noise 
distribution assumption is true, then tfiis minimization results in the maximum likelihood 
estimate of the parameterization, and by inference maximmn likelihood estimate of the 
transformation from the bone system to the cluster system. If the normal noise assumption 
is not true, the cM-squared estimate is still ^ypropriate for parameter estimation; the results 
25 cannot be interpreted as a maximum likelihood estimate, but, for example, confidence 
regions on the estimate or the formal covariance matrix of the fit can be determined. 

Obtaining the parameter set a is a computationally complex operation. The 
^roach taken was to define a scalar to represent this entire error matrix. 
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M >4 



and seek a that minimizes fl^a). 

5 The limits on marker motion previously discussed can now be converted into 

deformation constraints, which aUow the formulation of the problem as a general non-hnear 
p„>gramming problem. Th. constraints arise fiom two sources; human limb segments do 
,„,t deform outside a small range, and the locations of the markers are chosen with specific 
properties in mimL For computational purposes, the deformation constraints arc selected to 

10 be: 

1. THe axes of the cluster system moves by less than 15 degrees relative to the bone 
system. 

2. The center of mass of the cluster system moves by less than 3 cm relahve to the 

15 bone system. 

3 Themarkci8movebyless1han4cmrelativetothebonesystem. 

4. Each of the principal moments of inertia of the cluster system change by less than 25 

percent fix>m the reference values. 

Tbe Point auster Technique marker set was designed to ensure that the cluster of 
20 pomtsisnon^lanarandpossessnoaxesofrotationalsymmetry.TTiesepro^ 

a local coordinate system that is well defined and unambiguous over the entire time mtervaL 
The constraints are fhen: 

5 The ratio of the smallest principal moment of inertia of the cluster system to the 
largest is more than 5 percent the magnitude of flie smaUest principal moment of inertia of 

25 the chister system is greater than some small positive vahie. 

6. me principal moments of each axis are different fiom each other by at least 5 

ft 

percent 
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The general problem can then be fonnulated: 
Minmiize^a) 
Subject to: 
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gi(a) = 0 
&(a)<0 
ai<a<au 

5 where D is the total number of parameters; me, the number of equality constraints, is 

0; and m, the total number of constraints, is 10. 

The approach taken to verify flie operation of the algorithm implementation began 
with generating a set of 50 synthetic data sets with known characteristics: The program was 
then applied to aU of the data sets. The program results were then con^)ared to the known, 

10 generated deformation. Enror results were calculated for both the interval deformation 
technique descried herein and for the standard rigid body model formulation. 

The 50 trial data sets were processed through the algorithm. The results over all of 
the trial sets are summarized in Table I, where the center of mass and direction cosine error 
of the interval deformation technique and the rigid body model are compared. After 

15 processing by the interval deformation algorithm the center of mass error has been reduced 
to 29% and the direction cosine error has been reduced to 19% of the rigid body model 
error. In a t-test for paired samples, both of these decreases were significant at p < 0.001 . 

Validation of the Interval Deformation Correction Technique 

20 

A subject fitted with an Dizarov external fixation was observed with the 
optoelectronic system. The Point Chister Marker set was aflSxed to the subject's shank (6 
markers), along with a set of four markers rigidly attached to the Ilizarov device, which is 
rigidly connected to the tibia with bone pins. These four markers define a true bone 

25 embedded coordinate system. Data were acquired by GaitUnk software (Computerized 
Functional Testing Corporation) controlling four QuaUsys cameras operating at a video 
frequency of 120 Hz. Three dimensional coordinates were calculated using tfie modified 
direct linear transform. 

The subject was a 46 year old male Qieight 1.75 m, weight 84.1 kg) fitted with a 

30 tibial Ilizarov external fixation device. The device was rigidly attached to the tibia with 
nine bone pins, located in three sets (top, middle, and bottom) of three (medial, anterior, and 
lateral). The clinical purpose of the device was tibial lengthening the test on ttie subject 
was performed two days prior to final removal of the device. The subject exhibited a limited 
range of motion and was tested perfornung a 10 cm step-up onto a platform. 
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i = 1 .. rUc 
i = lUc + 1 m 
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n,e Simultaneously acquired motion for a coordinate system embedded in bone 
(Dizarov system) andasetofskin-basedmarkerswascompared. At every time instant the 

location and orientation of the Hizaiov system, the rigid body model skin maricer system, 
andtheintervaldefoimationtechniqueskinmaricersystemwasdetemnned. Thediangem 

5 thetransfomiationftomthemzaiovsystemtooneoftheskinmari.ersy^ 
measure of the deformation unaccounted for in the skin marker system. 

The interval deformation technique produced a substantial in^HOvement in &e 
estimate of the location and orientation of the miderlying bone. For perfectly modeled 
motion there would be no relative motion between the Dizarov system and the skin marker 

10 system over the time interval. Tl.e change in the transfomKitionfiom the Dizarov system to 
fl,e skin marker systems are shown in Figs. 14 and 15 for location and orientation 
respectively, for both a rigid body model and the interval deformation technique. For this 
single data set. the location error was reduced fiom 7.1 cm to 2.3 cm and the orientation 
error fiom 107 degrees to 24 degrees, with the error summed over the entire time interval 

15 Tte subject perfomied a 10 cm step-up; the maricer defomiation was modeled as a single 
Gaussian fimction. 

CORRELATING RESULTS FROM GAIT ANALYSIS AND GEOMETRICAL 
REPRESENTATIONS OF THE BONE 

20 In correlating the load pattern obtained fiom a gait analysis using. e.g. the PCT, with 

the geometrical representation of the bone fiom the segmented MRI data, one can be guided 
by the general process as described below. Hie process aUows for dynamic visualization 
(f.e animations) of high-resolution geometrical representations derived fiom MRI scans (or 
other imaging tecuuiques). The motion of the subject specific anatomic elements is 

25 generally driven by data acquired fiom the motion (gait) lab. Fidelity of these animations 
requires calculation and appUcation of a sequence of rigid body transformations, some of 
which are directly calculable and some of which are the result of optimizations (the 
correction for skin maricer deformation from rigidity does not use the rigid body 
assumption, but generates a correction that, is appUed as a rigid body transform). 

30 The process comprises: 

a) acquiring data from MRI (or other imaging techniques), and PCT gait 

protocols; 

b) directly caloilff^'^E a set of transformations fiom the data; 

c) calculating a set of transformations fiom optimizations, as needed; 
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d) generating a 3D geometric reptesentation of the uiatomic element from the 
MR data; and 

e) qjplying the transformations of (b) and (c) to the 3D geometric 
iq>resentation. 

5 Each of these steps are described in detail below. 

Acquiring the Data from MRI (or other imaging techniques) and PCT Gait Protocols 

In the Point Cluster Technique (PCT) protocol, a patient can have a number of 
10 retro-reflective markers attached to each limb segment under observation. Multiple video 
cameras acquire data with the subject standing still and during activities of interest 
In addition, in order to correspond activities in the gait lab with the MRI scans, another 
reference data set (subject standing still, prescribed posture) can be acquired using 8 
additional markers clustered about the knee. These markers are filled with gadolinium- 
1 5 DTP A and covered with a retro-reflective material to allow for correlation between the MRI 
image and the video data. 

Directly Calculating a Set of Transformations from the Data 

20 The transformations are described in detail in [Andriacchi TP, Alexander EJ, Toney 

MK, Dyiby CO, Sum J. J Biomech Eng 1998; 120(12): 743-749]. In short, each marker can 
be assigned a unit mass and the inertia tensor, center of mass, principal axes and principal 
moments of inertia can be calculated. By treating the center of mass and principal axes as a 
transformation, local coordinates arcan be e calculated. Another set of coordinate systems 

25 can also be required for tbis technique; limb segment specific anatomic landmarks can be 
identified through palpation and a clinically relevant coordinate system can be defined. The 
required transformations are suimnarized in Table 1 below. 



30 



Calculating a Set of Transformations from Optimizations 
There are tturee required transformations: 

Optimization 1. One can calculate the linear least, square error rigid body 
transformation fiom the MRI common local coordinate system to the VID common local 
coordinate system. 
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Optimization 2. For each liinb segmei^ one can calculate the linear least square 
rigid body transfonnation fiom the MRI limb segment anatomic cooniinate system to the 
video limb sclent an^omic coordinate system (obtained irom the gait analysis), usmg a 

subset of common markers appropriate for each segment 
5 Optimization 3. One can calculate a correction for the deviation of the limb segment 

fiom rigidity during each time step of the activity, using the per with either the mas^ 

,«UstnT,ution[AndriacchiTP.Alexanderm.ToneyMK.Dyrb^ 

1998- 120(12)- 743-749] or interval deformation algoritimis [Alexander EJ. Andnacdn TP: 
Corr^ting for defom^ation in skin-based mariner systems. Proceedings of tixe 3rd Annual 
10 Gait and Clinical Movement Analysis Meeting. San Diego. CA. 1998]. 

Generatinga 3D Geometric Representation ofthe Anatomic Element from theMRdata 

The MR sUces are segmented for the multiple anatomic and fiducial elements. THe 
sUces are combined to a voxel representation. An isosurfece can be calculated from the 
15 boundaryvoxelelements.Atessellationoftheisosurfacecanbecalculated,d^^^ 

outward pointing normal for each surfece element This data can then be stored m a 
standard 3D graphic format, tiie Virbial ReaUty Modeling language (VRML). 



Applying the Transformation Sequence to the Geometric Representation 

20 The transformation sequence is provided below in Table 1. This transformation 

sequence can be applied to each of tiie anatomic elements over each time step of ti»e 
activity, starting with sequence 6. 
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TableI 



Seq 


From System 


To System 


Xfokm 


1 


MR Global 


MRLocal 


EDI 


2 


MR Local 


Common Local 


OPTl 


3 


Common Local 


MR Anatomic 


ANA2 


4 


MR Anatomic 


VID Anatmnic 


OPT2 


5 


VXD Anatomic 


VIDRrf 


ANA3 


6 


VIDRef 


VID Defonned(t) 


EDS 


7 


Vn>Defoimed(t) 


VID Bone(t) 


0PT3 


8 


VlDBone(t) 


VID Global(t) 


ED4 



Correlating Marker Sets 

5 As pointed out at numerous places in the ^ecification, the use of external reference 

markers that are dvl^^iable by both MRI aiiJ optical techniques can be an important and 
useful tool in the method of this invention. The use of flie reference markers can form the 
basis for an aspect of this invention that is a method for correlating cartilage image data, 
bone image data, and/or opto-electrical image data for the assessment of the condition of a 

10 joint of a human. This method comprises^ obtaimng the cartilage image data of the joint 
with a set of skin reference markers placed externally near the joint, obtaining the bone 
image data of the joint with a set of skin reference markers placed externally near the joint, 
obtaining the external bone image data opto-electrical image data of the joint with a s^ of 
skin referaice mariners placed externally near the joint Using the skin reference markers, 

15 one can then correlate the cartilage image, bone image and opto-electrical image with each 
other, due to the fact that each skin reference marker is detectable in the cartilage, bone and 
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optc^lectricaldata. Tl»e cartilage imge data aiui the b<«e inu.ge data can be obtam^ 
noetic resonance hnaging. positron cnussion tomogn^hy, single photon enusaon 
computedtomography.uhrBsonnd.comput«ltomogr3phyorX-ray. TypicaUy.MRIvollbe 
preferred. In the case of X-ray. forther manipulations mnst be permed in which mul^^^^ 
5 x-ray images are assinrilated by a computer into a 2 dimensional aos=^«^^ 

calledaComputedTomogr^hyCTScan. The opto-electrical image data can be obtamed 
by any means, for example, a video c^era or a movie came.. Multiple skin reference 
n^ers can be placed on one or more limbs of the patient prior to imagmg. The skm 

reference markers are described hereinbefore. 
10 By a sequence of calculations a set of transformations that will take the subject 

specific geometric representation of anatomic elements determined from the MR image set 
to the optical reference coordinate system. From the optical reference coordinate system, 
the standard Point Ouster Technique transformation sequence is applied to generate 
dynamic visualizations of these anatomic elements during activities previously recorded m 
15 the motion lab. FideUty of these dynamic visualizations (and subsequent contact surface 
determination) requires the calculation and appUcation of a sequence of ngid body 
tnmsformations. Some of these are directly calculable and some are the result of 
optimizations (ttie correction for skin marker deformation from rigidity does not use the 
rigid body assmiqjtion, but generates a correction that is appUed as a rigid body transform). 
20 The first required transformation can be from the MR global coordinate system to 

the MR center ofmass/ principal axis coordinate system. This can be done by calculating 
the center of mass of each of the individual maricers, resulting in a set of eight three 
dimensional points. Each of these points can be assigned a unit mass, and the center of 
mass, inertia tensor, and principal axes can be calculated. The same procedure can be 
25 performedonthesemaikersasdeterminedbytheopticalsystem,providingatrans^^ 

from the optical global system to a center ofmass / principal axis system. 

If the relative orientation of the tibia and femur as determined by the MR system and 
the optical system are identical, it is only necessary to apply the optical reference system to 
the anatomic system transformation of the MR local data. If this is not the case, an 
30 optimization calculation can be perfomied to determine the rotation and tr^^^ 

example, flie femur with respect to the tibia. One then can calculate the linear least square 
rigid body transformation from the MR hmb segment anatomic coordinate system to the 
video limb segment amrtomic coordinate system prior to applying the Point Chister 
Transformations. 
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For visualization or contact surface determination, one can examine the relative 
motion of one segment to the other, for exanq>le the motion of the femur relative to a fixed 
tibial frame. This can be accomplished by applying the global to tibial anatomic system 

5 transfoim to all of the elements. An example of this type of visualization is given in 
Figure 18. The Figure shows what can be refenred to as fimctional joint imaging. Figure 
18A is a photogr^h demonstrating Ate position of the external markers positioned around 
the knee joint The markers are filled with dilute Gd-solntion. B is Sagittal 3D SPGR 
image through the medial femorotibial compartment. Two of the external markers are seen 

10 anteriorly as rounded structures with high signal intensity. C is 3D reconstinction of 
femoral and tibial bones (light grey), extemal markers (dark grey), femoral cartilage (red), 
and tibial cartilage (blue) based on the original SPGR MR images. D-I show a j&mctional 
joint imaging sequence at selected phases of leg extension fiom a seated position, D-F, 
anterior projection. The vectors represent the relative location and orientation of the femur 

15 with respect to the tibia. G-I is a lateral projection. These dynamic visualizations can be 
used to demonstrate tibiofemoral contact areas during various phases if gait or other 
physical activities. 

Superimposition of cartilage thickness map onto subject specific anatomic model and 
20 determination of distance of cartilage defect from load bearing line 

Superimposing the cartilage thickness m^s onto the subject specific geometric 
models can follow the same sqpproach taken to bring the MR generated geometries into the 
optical reference system. Since the thickness ms^s and the geometric models are initially in 

25 the same coordinate system; one possible q}proach is to perfonn a simple surface mq)ping 
of the thickness imop onto the geometric model. Another alternative sq^iproach is to convert 
the thickness mssp directiy into a geometric representation (Fig. 19). 

Once the thickness mq> is embedded in the femoral geometry, one can define a 
scalar metric that characterizes the location of any cartilage lesions relative to the point of 

30 contact line. One approach is a simple 3D distance along the surface firom the center of the 
cartilage lesion to the point of closest qyproach of the contact line. Another metric that 
could be usefiil would be to multiply flie area of the lesion by the adduction moment at that 
time instant, then divide by the distance firom lesion center to point of closest q>proaclL This 
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could result in a metric that increases with lesion area, adduction moment, aha closeness of 
appioddbu 

46 Display Correlated Images 

Determination of Anatomic and NaturaiRt^erence Lines 

There are two alternative approaches one can consider for determining a reference 
line on the cartUage surfaces. One skilled in the art will easily recognize olher approaches 
that can be suitable for this purpose. The first approach is based on anatomic planes; the 
second is a natural approach building on the three dimensional cartilage thickness m^^. 

•me location of the pathway of loading relative to the femoral and tibial anatomy 
and geometry can be assessed by defining sagittal planes bisecting the medial femoral, 
condyle, the lateral femoral condyle, the medial tibial plateau, and the latend tibial plateau. 
For the medial femoral condyle, the operator can manually delete surface points located 
along the trochlea. Then, a sagittal plane parallel to the sagittal midfemoral plane can be 

defined through themost medial aspect of the medial femoral condyle followed by a sagittal 
plane parallel to the sagittal midfemoral plane through the most lateral aspect of the medial 
femoral condyle. lUe sagittal plane that is located haUway between these two planes can be 
defined as &e •'midcondylar sagittal plane", llie intersection between the midcondylar 
sagittal plane and flie external cartilage surface yields the "anatomic midcondylar cartdage 
line" The location of the pathway of loading can be assessed relative to the anatomic 
nridcondyiar cartilage line of the medial femoral condyle. The identical procedure can be 
Ideated for thr '-/.jral f-moral condyle. 

The following method can be used for the medial tibial plateau: A plane parallel to 
die sagittal tiDial plateau plane can be defined through the most medial point of the medial 
tibial plateau. A parallel plane located halfway between this plane and the sagittal tibial 
plateau plane can yield the "midsagittal plane of the medial tibial plateau." The intersection 
of the midsagittal plane of the medial tibial plateau and the external cartilage surfece can 
) yidd the "anatomic midbT>ial plateau cartilage line" of the medial tibial plateau, llie 
identical procedure can be repealed for the lateral tibial plateau. 

In the second approach, one can calculate a "nahiral" Ime of curvature for each 
femoral cartilage component (Fig. 20). Intoiitively. if one could roU the femoral condyles 
along a hard, flat surfece, the line of contact with the flat surfece would be the natoiral line 
5 ofcurvature. One can compare the actual tibiofemoral contact line to this reference line. 
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Since one cannot physically remove the femur and roll it around, one can apply some 
geometric calculations to estimate this reference line. One can begin with the trans- 
epicondylar reference line previously described. One can then generate a plane coincident 
with this line oriented in an aibitraiy initial position. The intersection of this plane and the 

5 external surface of the cartilage will produce a curve. One can then take the point fiirthest 
from the trans-epicondylar reference line as the natural contact point for this plane location. 
The next step is to rotate the plane by some increment, for example by one degree, and 
repeat the procedure. The operator can identify the rotation angles where the plane is 
intersecting the distinct medial - lateral compartments of the cartilage, and two points can 

10 be chosen, one from the medial femoral condyle and one from the lateral femoral condyle. 
If cartilage defects aie present, in which case a compartment will not intersect in a curve but 
in a set of points, one can fit a spline through the points, then take the peak point of the 
spline as the contact point 

This can be repeated for the entire extent of the cartilage, resulting in a set of points 

15 fliat branch at the intercondylar notch. One can treat these pomts as two lines, and fit them 
with two splines. These can be the •^natural" lines of curvature for each conq)artment 

Load Bearing Line Determination 

20 The calculations in this section can begin with flie relative motion of the subject 

specific femoral anatomy with respect to the subject specific tibial anatomy, and end witti a 
line describing the point of closest approach between the femur and tibia during some 
activity of daily living. A number of qiproaches to this problem have been described in the 
literature; Crosset, Dennis, Stiehl, and Johnson have all described tecnniques which might 

25 be applicable. One can implement a proximity detection and q>proach algorithm (PDAA) 
as it was specifically designed to woric wifli the Point Cluster Technique (albeit with 
prosthetic knee joint components). 

Physically, the tibial and femoral cartilage conqponents deform under load, leading 
in general to a contact patch between opposing surfiu:es. As &e geometric models are rigid, 

30 they will not deform under this load, but will instead intersect in a non-realizable manner. 
The PDAA has been designed to incrementally displace and rotate one of the surfaces until 
a realizable contact is achieved. It is understood that this is not a true point contact line, but 
rather a reproducible representation of contact location (Fig. 21). 
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Tie Nffi geoenaed ^ g«»Betf« «m be >.«d to d««=. rigid 
co.«.pn»dmi.ywheo.he™bjeol«inMl««e.si«.^ Tiefeo»«lc™.p<«=a.cao*«b. 
inc«^e=uttydisplacedu.fflstaul«»»m«B.l«Kll«en*o.»l,leco^ TbB.s 
afimordaa^xtaadoa.o*e.oc,donof««con«.pom.;slipvdod.y«fcuh*o.^ 

5 tt,e.bcm«i.odeu™nethe«««l«dn>a«ofthec<««tp<«.Tl»n=ati^ 

tecdcuWcn. Tie Ml e^ensio. toe Step can k. chose, to ma«h«ia.fte«*o 
,eft«„» po*« should it be necessary, one can add B ote 

Once fte contact points have been detcnnined for all time steps of the aCmty, one 
,0 can map the locations ofth.se points onto the fernowl cartilage. A coorfin... aystem c»> 
be defined on the soAce of the fcanoral cartilage, choosing as a ref«enc Bne the p.n« of 
^ *e fenumd contponent would have had were it mUed along a flat plane. Ttas 
dlows one to delennineacont«« line idaive to the subject sp«»Seamtony. 

Provide Therapy 

15 A2Dor3Ds»rfi«e«.gistrationtedmLque«^ 

to the anatomic orieatadoaoffte cartflagethiclcn«« map of a baseline and foUow-up 
scanofapatient The n>.registercd cartilage tirictoess map of the foflow-up «^ 
be subtracted from the baseline scaa This will yield the thickness difference. i.e. cartUage 
loss.asa&nctionofx.y.andz. This can also be expressed as percentage difference. 
20 The invention provides for techniques to assess biomechanical loading conditions of 

articular cartilage invh^usingmagnetic resonance imaging andto 
aidinprovidingtherapytoapatient M one embodiment. biom«*anical loading conditions 
can be assessed in normal articular cartilage in various anatomic regions, hithekneejomt. 
these anatomic regions include tiie posterior, central, and anterior medial f^^^ 
25 the posterior, central, and anterior medial til,ial plateau, the posterio^^ 
lateral femoral condyle, the posterior, central, and anterior lateral h^^^ 
and lateral aspect of the trochlea, and flie medial and lateral fecet and the median ndge of 
thepatella. Since biomechanical loading conditions are assessed in vh« based 
anatomic features of each individual patient, a risk profile can be established for each 
30 individualbasedonthebiomechanicalstressesjwfiedtocartilage. to this feshion. patients 
who are at risk for developing early cartilage loss and osteoarthritis can be identified. For 
example, patients withavalgus or varus defonnity of thekneejokt will demonstrate higher 

biomechanical stresses appUed to the articular cartilage in the medial femorotibial or lateral 
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femoiotibial or pateUofemoral compartments than patients with normal joint anatomy. 
Similarly, patients with disturbances of joint congniity will demonstrate higher 
biomechanical stress appUed to certain regions of the articular cartilage. Such disturbances 
of joint congniity are often difificult to detect using standard cKnical and imaging 
5 assessment The amount of stress applied to the articular cartilage can be used to detennine 
the patient's individual prognosis for developing cartilage loss and osteoarfiiritis. Jn another 
embodiment, biomechanical loading conditions can be assessed in normal and diseased 
articular cartilage. An intervention that can alter load bearing can then be simulated Such 
mterventions include but are not limited to braces, orthotic devices, methods and devices to 

10 alter neuromuscular function or activation, arthroscopic and surgical procedures. The 
change in load bearing induced by the intervention can be assessed prior to actually 
performing the intervention in a patient In this fashion, the most efiBcacious treatment 
modality can be deteraiined. For example, a tibial osteotomy can be simulated in the 
manner and the optimal degree of angular correction with regard to biomechanical loading 

15 conditions of normal and diseased cartilage can be detennined before the patient will 
actually undergo surgery. 

Estimation of biomechanical forces appUed to normal cartilage can be used to 
detennine a patient's risk for developing cartilage loss and osteoarthritis. Estimation of 
forces app^ed in and around a cartilage defect can be used to determine the prognosis of a 

20 cartilage defect and to guide the choice of therapy, e.g. treatment with chondroprotective or 
chondroregenerative agents, osteochondral allografting, cartilage transplantation, femoral or 
tibial osteotomy, or joint replacement surgery. 

Having now provided a full discussion of various aspects of the technology relating to this 
invention, seveidi iurthcr aspects of tiii/ invention can be seen. 
25 One aspect of tihe invention is a method of assessing the condition of a joint in a 

mammal. The metiiod comprises: 

(a) coiiq)aring the movement pattern of the joint with the cartilage degeneration 
pattern of the joint; and 

(b) determining the relationship between the movCTient pattern and tibe cartilage 
30 degeneration pattern 

Another aspect of the invention is a method for monitoring the treatment of a 
degenerative joint condition in a mammal. The method comprises 

(a) comparing the movement pattern of the joint with the cartilage degeneration 
pattem of the joint: 
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(b) detenniDing the relationship between the movement pattern and the cartilage 
degeneration pattern; 

(c) Heating the mammal to mimmize further degeneration of the joint condition; 

and 

5 (d) monitoring the treatment to the mammal. 

Stm another aspect of the invention is a method of assessing the rate of degeneration 
of cartUage in the joint of a mammal, wherein the joint comprises cartflage and the bones on 
either side of the cartilage, which method comprises 

(a) obtaining a cartUage degeneration pattern of the joint that shows an area of 

1 0 greater than normal degeneration, 

(b) obtaining a movement pattern of the joint that shows where the opposing 

cartilage surface contact, 

(c) conq)aring the cartilage degeneration pattern with the movement pattern of 

the joint, and 

15 (d) deteraiining if the movement pattern shows contact of one cartilage suifece 

with a portion of the opposing cartilage surfece showing greater than normal degeneration 
in the cartilage degoieration pattern. 

Another a^ect of the specification is a method for assessing the condition of the 
knee joint of a human patient, wherein the knee joint comprises cartUage and associated 

20 bones on either side of the joint The method comprises 

(a) obtaining the patient's magnetic resonance imaging (MW) data of the knee 
showing at least the cartUage on at least one side of the joint, 

(b) segmentii^ the MRI data &om step (a), 

(c) generating a geometrical or biochemical representation of the cartUage of the 

25 joint from the s^mented MRI data, 

(d) assessing the patient's gait to det«amine the cartUage surface contact pattern 

m the joint during the gait assessment, and 

(e) correlating the contact pattern obtained in step (d) with the geometrical 

rqffesentation obtained in stq> (c). 
30 Stfll another aspect of this invention is a method for assessing the condition of the 

knee joint of a human patient, wherein the knee joint conqirises cartUage and associated 
bones on either side of the joint The method comprises 

(a) obtainmg flie patient's magnetic resonance imaging (MRI) data of the knee 
showing at least the bones on mtiier side of the joint. 
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(b) segmenting Jidlv[RI data from £^ep (a), 

(c) generating a geometrical representation of the bone of tbe joint from the 
segmented MRI data, 

(d) asff»»ang the patient's gait to determine the load pattern of the articular 
S cartilage in the joint during the gait assessment, 

(c) correlating the load pattern obtained in step (d) with the geometrical 
zepresentation obtained in step (c). 

Another aspect of tins invention is a method for deriving the motion of bones about a joint 
from markers placed on ttie skin, which method comprises 
10 (a) placing at least three external markers on the patient's limb segments 

surrounding the joint, 

(b) registering the location of each marker on the patient's limb while the patient 
is standing completing still and while moving the limb, 

(c) calculating the principal axis, principal moments and deformation of rigidity 
IS of the cluster of markers, and 

(d) calculating a correction to the artifact induced by the motion of the skin 
markers relative to the underlying bone. 

Another aspect of the invention is a system for assessing the condition of cartilage in a joint 
of a human, which system comprises 
20 (a) a device for electronically transferring a cartilage degeneration pattern for 

the joint to receiving device located distant from the transferring device; 

(b) a device for receiving the cartilage degeneration pattern at the remote 
location; 

(c) a database accessible at the remote location for generating a movement 
25 pattern for the joint of the human wherein the database includes a collection of movement 

patterns for himtian joints, which patterns are organized and can be accessed by reference to 
characteristics such as type of joint, gender, age, height, weight, bone size, type of 
movement, and distance of movonent; 

(d) a device for generating a movement pattern that most closely s^proximates a 
30 movement pattern for the human patient based on tiie charactoistics of the human patient; 

(e) a device for conelating the movement pattern with the cartilage degeneration 
pattern; and 

(f) a device for transmitting the correlated movement pattern with the cartilage 
degeneration pattern back to the source of the cartilage degeneration pattern. 
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In each of these aspects of the invention it is to be understood that a cartilage 
degeneration pattern may be. La., 2D or 3D thickness map of the cartilage or a biochemical 
map of the cartilage- 

All publications and patent applications mentioned in this specification are herein 
incorporated by reference to the same extent as if each individual pubUcation or patent 
appUcation was specifically and individually indicated to be incorporated by reference. 

The invention now being fully described, it will be apparent to one of ordinary skill 
in the art that many changes and modifications can be made thereto without departing fiom 
the spirit or scope of the appended claims. 
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What is claimed is: 

1. A method of treating a human wifli a joint disease involving cartilage, which method 
comprises: 

5 obtaining an electronic image of said joint, wherein said image includes both normal 

and diseased cartilage tissue; 

electronically evaluating said image to obtain information comprising volume, area, 
thickness, curvature, geometry, biochemical contents, signal intensity or relaxation time of 
said normal or diseased tissue; and 

10 selecting a ther^y based on said information. 

2. The method of claim 1, wherein said electronically evaluating comprises a method 
selected from the groiqp consisting of: 

(1) a method of estimiating die loss of cartilage in a joint, wherein the joint 
IS comprises cartilage and accompanying bones on either side of flie joint, which method 

comprises obtaining a three-dimensional m^ of die cartilage at an initial time and 
calculating the thickness or regional volume of a region of degenerated cartil^e so mapped 
at the irdtial time, obtaining a three-dimensional map of tiie cartilage at a later time, and 
calculating the thickness or regional volume of a region of degenerated cartilage so mapped 
20 at the later time, and determining the loss in thickness or regional volume of the region of 
degenerated cartilage between the later and initial times; 

(2) a method for assessing the condition of cartilage in a joint of a human, which 
method comprises electronically transferring an electronically generated image of a 
cartilage of the joint from a transferring device to a receiving device located distant fix>m the 

25 transferring device; receiving the transferred image at the distant location; converting the 
transferred image to a degeneration pattern of the cartilage; and transmitting the 
degeneration pattern to a site for analysis; 

(3) a method for detennining the volume of cartilage loss in a region of a cartilage 
defect of a cartilage in a joint of a manmial which method coniprises determining the 

30 thickness, Dn> of the normal cartilage near the cartilage defect; obtaiiung the thickness of 
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the cartilage defect. Do, of tiie region; subtracting Do from Dn to give the thickness of fte 
cartilage loss, Dl; and multiplying the Dl value times the area of the cartilage defect. Ad, to 
give the volume of cartilage loss; 

(4) a method of estimating the change of cartilage in a joint of a mammal over time, 
5 whidi method comprises estimating the thickness or width or area or volume of a region of 

cartilage at an initial time Ti; estimating the tiiiickness or widdi or area or volume of the 
region of cartilage at a later time T2; and determining flie change in ttie thickness or width or 
area or volume of the region of cartilage between the initial and the later times; 

(5) a method for providing a biochemically based of joint cartilage of a 
10 mammal, wherein the joint conqnises cartilage and associated bones on either side of the 

joint, which method comprises measuring a detectable biochemical component throughout 
the cartilage; detennining the relative amounts of the biochemical component throughout 
the cartilage; mapping the amounts of the biochemical component in three dimensions 
tbrough the cartilage; and detennining the areas of abnormal joint cartilage by identifying 
1 5 the areas having altered amounts of the biochemical component present; 

(6) a method of estimating the change of cartilage in a joint, wherein the joint 
comprises articular cartilage, which method comprises defining a 3D object coordinate 
system of the joint at an initial time, Ti; identifying a region of a cartilage defect within the 
3D object coordinate system; defining a volume of interest around the region of tiie 

20 cartilage defect whereby the volume of interest is larger than the region of cartilage defect, 
but does not encompass the entire articular cartilage; defining the 3D object coordinate 
system of the joint at a second timepoint, T2; placing the identically-sized volume of interest 
into the 3D object coordinate system at timepoint T2 using the object coordinates of the 
volume of interest at timepoint Ti; and measuring any differences in cartilage volimie within 

25 the volume of interest between timepoints Ti and T2; and 

(7) a method for correlating cartilage image data, bone image data, and opto- 
electrical image data for the assessment of the condition of a joint, which method comprises 
(a) obtaining the cartilage image data of the joint with a set of skin reference markers placed 
externally near the joint; (b) obtaining the bone image data of the joint with a set of skin 

30 reference markers positioned in the same manner as the markers in; (c) obtaining the opto- 
electrical image data of die joint with a set of skin reference markers positioned in the same 
manner as (a) and (b); and using the skin reference markers to correlate the images obtained 

76 



wo 02/22014 PCT/USOl/28680 

in (a), (b) and (c) with each other, wherein each skin reference marker is detectable in the 
cartilage and bone data and the opto-electrical data; 

3. The method of claim 1, wherein said electronic image provides inforaiation on the 
thickness, shape, or curvature of said normal and said disease tissue or the location and size 

5 of said diseased tissue. 

4. The method of claim 1, wherein said therapy comprises autologous chondrocyte 
transplantation, osteochondral allografting, osteochondral autografling, tibial corticotomy, 
femoral or tibial osteotomy. 

5. The method of claim 1, wherein said ther^y uses cartilage or bone tissue grown ex 
10 vivo, stem cells, an artificial non-human material, an agent that stimulates repair of said 

diseased tissue, or an agent that protects said diseased tissue and that protects adjacent 
normal tissue. 

6. The method of claim 1 , wherein said information is used to determine the thickness 
or othCT geometrical feature of a tissue transplant, a tissue graft, a tissue implant, a tissue 

15 Tq)lacement material, a tissue scafifold, or a tissue regenerating material or tissue repair 
systffli. 

7. The method of claim 1, wherem said image is obtained using ultrasound, computed 
tomograq)hy, positron emission tomotr^hy, a single photon emission computed tomography 
scan»orMRI. 

20 8. The method of claim 7, wherein said information is used to generate a three- 
dimensional map of cartilage tiiiclmess or a physical model of said normal or said diseased 
tissue or both. 

9. The method of claim 8, wherein Mid physical model is used to sh^e a tissue 
transplant, a tissue graft, a tissue implant, a tissue replacement material, a tissue scaffold or 

25 a tissue regenerating material or tissue repair system. 

10. A metiiod of treating a human with cartilage degeneration in a joint, which method 
comprises: 

obtaming an electronic image of said joint, wherein said image includes both and 
diseased cartilage; 
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electi jnically evaluating said image to obtain information comprising volmne, area, 
ttiickness, geometry, biochemical contents or relaxation time of said normal or diseased 
tissue; and 

selecting a ther^y to treat or rq)lace said degenerated cartilage, wherein said 
5 information is used during selection of treatment or rq)lacement tiierspy of said degenerated 
cartilage. 

11. The method of claim 10, wherein said information mcludes thickness, sh^, 
curvature, or location and dimensions of said normal or degenerated cartilage, 

12. The method of claim 10, wherein said technique to treat or replace said degenerated 
10 cartilage is autologous chondrocyte transplantation, osteochondral allografting, 

osteochondral autografting, tibial corticotomy, or femoral or tibial osteotomy. 

13. The method of claim 10, wherein said treatment or replacement therapy uses 
cartilage or bone tissue grown ex vivo, stem cells, an artificial non-human material, an agent 
that stimulates repair of said diseased tissue, or an agent that protects said diseased tissue 

IS and that protects adjacent normal tissue. 

14. The method of claim 10 wherein said information is used to deterimine the 
thickness, shape, curvature, or location and dimensions of a cartilage transplant, a cartilage 
graft, a cartilage implant, a cartilage replacement material, a scaffold for cartilage cells or 
acellular cartilage components or a cartilage regenerating material or a cartilage repair 

20 system. 

15. The method of claim 10, wherein said image is obtained using ultrasound, computed 
tomography, positron emission tomognq>hy, a single photon emission computed 
tomography scan, or MRI. 

16. The method of claim 10, wherein said information is used to generate a three- 
25 dimensional map of cartilage tfiickness or a physical model of said normal or said diseased 

tissue or both. 

17. The method of claim 16, wherein said physical model is used to shape a cartilage 
tranq>lant, a cartilage graft, a cartilage implant, a cartilage replacement material, a scaffold 
or a cartilage regenerating material or a cartilage repair system. 
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18. The method of claim 16, wherein physical model comprises an area of diseased 
cartilage as well as adjacent normal tissue. 

19; The method of claim 18, wherein said adjacent normal tissue is bone, bone marrow, 
or normal cartilage. 

5 20. The method of claim 16, wherein said physical model is created witti use of a 3D 
Euclidian distance transformation. 

21. The method of claim 16, wherein said physical model or a portion of said physical 
model is implanted into a knee joint 

22. The method of claim 16, wherein said physical model carries cartilage cells or 
10 cartilage matrix. 

23. A method of treating a human with diseased cartilage in a joint, ^ch method 
comprises: 

utilizing an MRI scan to generate a cross-sectional electronic image of said joiiit, 
wherein said image includes both normal and diseased cartilage; and 

15 utilizing information from said image to create a geometric model of an area of 

diseased cartilage, wherein said geometric model is used in selecting a treatment of said 
diseased cartUage. 

24. The method of claim 23, wherein said area of diseased cartilage includes adjacent 
normal tissue. 

20 25. The method of claim 23, wherein said geometric model is used to determine the 
shape of a cartilage transplant, a cartilage graft, a cartilage implant, a cartilage replacement 
material, a scaffold for cartilage cells or acellular cartilage components or a cartilage 
regenerating material or a cartilage repair system. 

26. A method of assessing cartilage disease in a joint, wherein the joint comprises 
25 cartilage and accompanying bones on either side of the joint, which method comprises: 

obtaining a three-dimensional m^ of the cartilage demonstrating the thickness or 
biochemical contents or relaxation time of normal and diseased cartilage; and 
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detennming the margins of the diseased cartikge in relationship to the nonnal 
cartilage in said three-dimensional msp. 

27. The method of claim 26, wherein said detemmiation of said margins of said diseased 
cartilage is performed by detecting a difference in said thickness, said biochemical contents 

5 or said relaxation time between said normal and said diseased cartilage. 

28. The method ofclaim 26, wherein said detenninationofsaid margins of said diseased 
cartilage is used to determine the area, volume, or thickness of diseased cartilage. 

29. The method ofclaim 26, wherem said deteimination of said margins of said diseased 
cartUage is used to deteimine the percentage of total cartilage surface area in a joint or along 

10 an articular surfece represented by diseased cartilage or the percentage of weight-bearing 
surface area in a joint represoited by diseased cartilage. 

30. The method of Claim 26. wherem steps (a) flnough (b) are carried out at an initial 
time (Ti) and are carried out again at a later time (T2). 

31 . The mediod of Qaim 30, wherein the estimation includes an analysis of Ae degree 
1 5 of degeneration of the cartilage between Ti and T2. 

32. The mefliod of Qaim 26, wherdn an MRI technique first obtains a series of two- 
dimensional views of the joint, which are then mathematically integrated to give a three- 
dimensional image. 

33. The method of Claim 32, wherein the MRI technique employs a gradient echo, spin 
20 edK), fast-spin echo, driven equilibrium Fourier transform, or spoiled gradient echo 

technique. 
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